-- Logs begin at Tue 2022-08-09 15:29:57 UTC, end at Tue 2022-08-09 16:53:17 UTC. -- Aug 09 16:25:32.173473 dv-osbrick-852610-1-ceph systemd[1]: Starting Devstack devstack@keystone.service... Aug 09 16:25:32.182583 dv-osbrick-852610-1-ceph devstack@keystone.service[87270]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 09 16:25:32.185182 dv-osbrick-852610-1-ceph devstack@keystone.service[87270]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Aug 9 16:25:32 2022] *** Aug 09 16:25:32.185182 dv-osbrick-852610-1-ceph devstack@keystone.service[87270]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 09 16:25:32.185182 dv-osbrick-852610-1-ceph devstack@keystone.service[87270]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 09 16:25:32.185182 dv-osbrick-852610-1-ceph devstack@keystone.service[87270]: nodename: dv-osbrick-852610-1-ceph Aug 09 16:25:32.185182 dv-osbrick-852610-1-ceph devstack@keystone.service[87270]: machine: x86_64 Aug 09 16:25:32.185182 dv-osbrick-852610-1-ceph devstack@keystone.service[87270]: clock source: unix Aug 09 16:25:32.185182 dv-osbrick-852610-1-ceph devstack@keystone.service[87270]: pcre jit disabled Aug 09 16:25:32.185182 dv-osbrick-852610-1-ceph devstack@keystone.service[87270]: detected number of CPU cores: 4 Aug 09 16:25:32.185182 dv-osbrick-852610-1-ceph devstack@keystone.service[87270]: current working directory: / Aug 09 16:25:32.185182 dv-osbrick-852610-1-ceph devstack@keystone.service[87270]: detected binary path: /usr/bin/uwsgi-core Aug 09 16:25:32.185182 dv-osbrick-852610-1-ceph devstack@keystone.service[87270]: your processes number limit is 47680 Aug 09 16:25:32.185182 dv-osbrick-852610-1-ceph devstack@keystone.service[87270]: your memory page size is 4096 bytes Aug 09 16:25:32.185182 dv-osbrick-852610-1-ceph devstack@keystone.service[87270]: detected max file descriptor number: 2048 Aug 09 16:25:32.185182 dv-osbrick-852610-1-ceph devstack@keystone.service[87270]: lock engine: pthread robust mutexes Aug 09 16:25:32.185951 dv-osbrick-852610-1-ceph devstack@keystone.service[87270]: thunder lock: enabled Aug 09 16:25:32.185951 dv-osbrick-852610-1-ceph devstack@keystone.service[87270]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 09 16:25:32.185951 dv-osbrick-852610-1-ceph devstack@keystone.service[87270]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 09 16:25:32.229582 dv-osbrick-852610-1-ceph devstack@keystone.service[87270]: Python main interpreter initialized at 0x55963fbc49c0 Aug 09 16:25:32.229582 dv-osbrick-852610-1-ceph devstack@keystone.service[87270]: python threads support enabled Aug 09 16:25:32.229582 dv-osbrick-852610-1-ceph devstack@keystone.service[87270]: your server socket listen backlog is limited to 100 connections Aug 09 16:25:32.229582 dv-osbrick-852610-1-ceph devstack@keystone.service[87270]: your mercy for graceful operations on workers is 90 seconds Aug 09 16:25:32.229957 dv-osbrick-852610-1-ceph devstack@keystone.service[87270]: mapped 403077 bytes (393 KB) for 2 cores Aug 09 16:25:32.230037 dv-osbrick-852610-1-ceph devstack@keystone.service[87270]: *** Operational MODE: preforking *** Aug 09 16:25:32.230262 dv-osbrick-852610-1-ceph devstack@keystone.service[87270]: *** uWSGI is running in multiple interpreter mode *** Aug 09 16:25:32.230262 dv-osbrick-852610-1-ceph devstack@keystone.service[87270]: spawned uWSGI master process (pid: 87270) Aug 09 16:25:32.230467 dv-osbrick-852610-1-ceph systemd[1]: Started Devstack devstack@keystone.service. Aug 09 16:25:32.233939 dv-osbrick-852610-1-ceph devstack@keystone.service[87270]: spawned uWSGI worker 1 (pid: 87275, cores: 1) Aug 09 16:25:32.233939 dv-osbrick-852610-1-ceph devstack@keystone.service[87270]: spawned uWSGI worker 2 (pid: 87276, cores: 1) Aug 09 16:25:32.233939 dv-osbrick-852610-1-ceph devstack@keystone.service[87270]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 09 16:25:38.023099 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 09 16:25:38.023099 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: from cryptography.utils import int_from_bytes Aug 09 16:25:38.023856 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 09 16:25:38.023856 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: from cryptography.utils import int_from_bytes Aug 09 16:25:38.024257 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 09 16:25:38.024257 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: from cryptography.utils import int_from_bytes Aug 09 16:25:38.024375 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 09 16:25:38.024375 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: from cryptography.utils import int_from_bytes Aug 09 16:25:38.073215 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 09 16:25:38.073372 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 09 16:25:38.073460 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 09 16:25:38.073535 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 09 16:25:38.073603 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] command line args: [] {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 09 16:25:38.073667 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] command line args: [] {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 09 16:25:38.073837 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 09 16:25:38.073945 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 09 16:25:38.074025 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] ================================================================================ {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 09 16:25:38.074098 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] ================================================================================ {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 09 16:25:38.074280 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] admin_token = **** {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:25:38.074368 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] admin_token = **** {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:25:38.074525 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] config_dir = [] {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:25:38.074617 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] config_dir = [] {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:25:38.074730 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:25:38.074924 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:25:38.074924 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] config_source = [] {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:25:38.075188 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] config_source = [] {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:25:38.075328 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] debug = True {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:25:38.075463 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] debug = True {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:25:38.075463 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:25:38.075887 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:25:38.075887 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:25:38.076036 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:25:38.076101 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] insecure_debug = False {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:25:38.076169 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] insecure_debug = False {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:25:38.076229 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:25:38.076286 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:25:38.076342 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:25:38.076404 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:25:38.076462 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] list_limit = None {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:25:38.076527 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] list_limit = None {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:25:38.076623 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] log_config_append = None {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:25:38.076701 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] log_config_append = None {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:25:38.076797 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:25:38.076871 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:25:38.076973 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] log_dir = None {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:25:38.077048 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] log_dir = None {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:25:38.077147 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] log_file = None {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:25:38.077222 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] log_file = None {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:25:38.077562 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:25:38.077646 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:25:38.077646 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:25:38.077779 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:25:38.077839 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:25:38.077918 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:25:38.078120 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:25:38.078209 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:25:38.078283 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:25:38.078346 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:25:38.078463 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:25:38.078551 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:25:38.078690 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:25:38.078767 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:25:38.078933 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:25:38.079056 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:25:38.079168 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:25:38.079247 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:25:38.079403 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:25:38.079495 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:25:38.079632 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:25:38.079748 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:25:38.079909 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:25:38.080018 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:25:38.080087 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:25:38.080147 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:25:38.080334 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] notification_format = cadf {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:25:38.080456 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] notification_format = cadf {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:25:38.080607 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:25:38.080693 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:25:38.081087 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.104/identity {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:25:38.081224 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.104/identity {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:25:38.081309 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] publish_errors = False {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:25:38.081433 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] publish_errors = False {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:25:38.081518 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:25:38.081603 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:25:38.081703 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:25:38.081789 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:25:38.081892 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:25:38.082009 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:25:38.082157 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:25:38.082422 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:25:38.082422 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:25:38.082614 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:25:38.082614 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] standard_threads = False {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:25:38.082850 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] standard_threads = False {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:25:38.082926 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] strict_password_check = False {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:25:38.083002 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] strict_password_check = False {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:25:38.083073 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:25:38.083142 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:25:38.083270 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] use_eventlog = False {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:25:38.083348 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] use_eventlog = False {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:25:38.083418 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] use_journal = False {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:25:38.083487 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] use_journal = False {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:25:38.083556 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] use_json = False {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:25:38.083626 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] use_json = False {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:25:38.083707 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] use_stderr = False {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:25:38.083785 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] use_stderr = False {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:25:38.083886 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] use_syslog = False {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:25:38.083967 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] use_syslog = False {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:25:38.084117 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] watch_log_file = False {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:25:38.084198 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] watch_log_file = False {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 16:25:38.084408 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.084500 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.084648 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.084760 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.084905 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.085016 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.085123 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.085220 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.085468 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.085568 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.085654 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.085733 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.085839 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.085954 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.086106 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.086186 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.086352 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.086438 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.086597 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.086682 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.086842 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.086922 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.087075 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.087155 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.087320 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.087399 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.087553 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.087634 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.087797 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.087877 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.088025 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.088100 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.088266 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.088346 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.088522 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.088610 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.088776 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.088863 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.089022 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.089106 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.089259 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.089346 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.089510 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.089594 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.089780 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.089859 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.090052 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.090145 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.090302 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.090380 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.090529 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.090608 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.090756 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.090843 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.090982 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.091060 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.091219 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.091298 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.091467 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.091557 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.091714 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.091792 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.091942 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.092021 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.092172 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.092261 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.092419 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.092498 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.092665 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.092742 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.092902 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.092988 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.093148 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.093226 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.093379 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.093456 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.093612 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.093764 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.093839 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.093929 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.094088 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.094170 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.094318 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.094405 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.094542 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.094624 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.094769 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.094848 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.095005 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.095091 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.095250 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.095336 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.095478 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.095556 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.095712 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.095799 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.095939 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.096017 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.096173 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.096250 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.096408 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.096495 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.096650 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.096733 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.096878 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.096958 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.097116 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.097208 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.097349 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.097427 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.097585 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.097673 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.097823 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.097953 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.098084 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.098164 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.098315 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.098394 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.098563 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.098645 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.098799 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.098887 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.099035 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.099117 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.099263 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.099351 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.099529 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.099617 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.099763 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.099843 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.100015 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.100093 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.100251 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.100331 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.100483 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.100568 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.100747 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.100826 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.100978 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.101058 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.101220 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.101305 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.101462 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.101549 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.101696 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.101783 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.101946 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.102030 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.102183 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.102262 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.102431 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] cache.enabled = True {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.102513 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] cache.enabled = True {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.102667 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.102755 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.102900 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.102979 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.103138 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.103219 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.103374 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.103452 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.103610 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.103689 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.103844 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.103924 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.104076 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.104156 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.104310 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.104394 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.104567 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.104648 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.104806 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.104892 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.105042 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.105128 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.105280 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.105356 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.105515 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.105595 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.105751 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.105842 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.106008 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.106090 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.106243 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.106333 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.106469 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.106548 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.106695 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.106785 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.106921 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.107000 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.107155 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.107236 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.107381 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.107467 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.107618 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.107697 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.107853 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.107932 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.108097 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.108185 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.108333 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.108419 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.108583 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.108661 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.108839 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.108931 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.109076 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.109155 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.109306 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] auth.external = None {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.109384 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] auth.external = None {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.109532 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] auth.mapped = None {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.109618 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] auth.mapped = None {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.109827 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.109967 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.110076 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.110158 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.110305 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] auth.password = None {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.110383 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] auth.password = None {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.110531 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] auth.token = None {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.110619 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] auth.token = None {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.110768 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.110849 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.111000 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] catalog.caching = True {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.111080 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] catalog.caching = True {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.111355 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.111443 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.111586 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.111666 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.111830 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.111910 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.112076 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.112164 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.112305 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.112385 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.112540 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] credential.caching = True {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.112619 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] credential.caching = True {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.112783 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] credential.driver = sql {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.112870 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] credential.driver = sql {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.113030 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.113110 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.113275 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.113354 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.113515 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.113650 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.113758 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.113883 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.114033 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.114107 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.114280 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.114375 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.114535 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.114616 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.114775 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.114856 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.115025 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.115106 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.115307 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.115395 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.116068 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.116153 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.116332 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.116413 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.116569 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.116649 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.116824 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.116904 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.117063 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] federation.caching = True {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.117145 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] federation.caching = True {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.117299 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.117378 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.117543 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] federation.driver = sql {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.117624 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] federation.driver = sql {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.117788 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.117872 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.118038 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.118121 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.118285 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.118366 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.118521 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.118611 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.118772 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.118854 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.119007 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.119088 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.119259 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.119342 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.119494 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.119575 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.119739 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.119819 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.119963 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] identity.caching = True {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.120045 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] identity.caching = True {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.120205 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.120288 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.120448 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.120528 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.120680 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.120761 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.120913 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.121001 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.121154 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] identity.driver = sql {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.121236 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] identity.driver = sql {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.121381 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.121468 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.121604 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.121685 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.121848 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.121959 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.122119 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.122202 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.122353 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.122432 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.122579 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.122658 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.122808 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.122890 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.123050 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.123193 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.123292 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.123373 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.123537 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.123626 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.123788 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.123869 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.124037 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.124150 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.124303 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.124394 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.124540 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.124621 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.124776 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.124864 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.125006 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.125084 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.125241 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.125319 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.125470 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.125559 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.125703 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.125781 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.125962 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.126047 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.126202 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.126292 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.126447 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.126525 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.126676 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.126753 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.126917 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.127006 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.127161 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.127238 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.127395 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.127472 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.127637 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.127765 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.127880 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.127959 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.128107 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.128186 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.128343 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.128430 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.128570 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] ldap.password = **** {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.128647 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] ldap.password = **** {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.128805 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.128881 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.129045 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.129244 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.129357 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.129435 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.129506 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.129575 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.129730 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.129818 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.130000 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.130082 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.130250 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.130328 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.130481 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.130571 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.130708 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.130787 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.130952 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.131030 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.131824 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.132028 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.132109 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.132180 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.132251 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.132328 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.132445 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.132534 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.132676 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] ldap.user = None {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.132755 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] ldap.user = None {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.132916 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.132995 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.133175 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.133262 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.133406 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.133485 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.133651 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.133730 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.133893 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.134007 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.134156 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.134235 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.134391 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.134470 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.134650 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.134749 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.134846 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.134924 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.135079 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.135157 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.135312 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.135398 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.135539 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.135616 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.135778 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.135855 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.136020 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.136105 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.136260 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.136337 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.136502 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.136580 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.136752 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.136837 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.136978 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.137057 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.137225 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.137303 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.137461 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.137547 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.137698 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.137815 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.137932 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.138008 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.138173 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.138266 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.138417 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.138496 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.138660 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.138739 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.138896 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.138986 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.139145 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] policy.driver = sql {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.139224 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] policy.driver = sql {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.139372 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.139450 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.139616 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.139700 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.139847 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.139927 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.140080 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] receipt.caching = True {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.140157 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] receipt.caching = True {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.140313 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.140392 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.140553 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.140632 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.140790 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.140867 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.141014 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.141093 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.141246 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.141323 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.141481 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] resource.caching = True {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.141558 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] resource.caching = True {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.141729 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.141813 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.141997 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] resource.driver = sql {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.142081 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] resource.driver = sql {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.142234 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.142314 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.142483 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.142563 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.142730 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.142807 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.142967 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] revoke.caching = True {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.143069 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] revoke.caching = True {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.143213 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.143278 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.143428 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.143519 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.143659 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] role.cache_time = None {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.143739 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] role.cache_time = None {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.143890 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] role.caching = True {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.143972 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] role.caching = True {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.144130 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] role.driver = sql {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.144210 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] role.driver = sql {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.144358 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] role.list_limit = None {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.144437 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] role.list_limit = None {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.144603 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.144685 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.144844 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.144925 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.145087 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.145166 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.145328 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.145409 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.145569 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.145650 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.145808 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.145887 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.146077 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.146159 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.146323 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.146403 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.146553 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.146633 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.146822 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.146927 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.147066 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.147175 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.147311 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.147420 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.147555 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.147663 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.147943 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.148048 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.148180 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.148268 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.148427 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.148509 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.148676 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.148756 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.148923 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.149011 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.149170 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.149251 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.149428 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.149507 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.149680 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.149954 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.150204 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.150286 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.150445 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.150605 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.150685 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.150861 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.150944 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.151093 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.151174 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.151325 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.151404 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.151577 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.151660 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.151830 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.151912 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.152065 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.152145 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.152301 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.152382 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.152530 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] token.cache_time = None {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.152609 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.152757 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] token.cache_time = None {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.152836 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] token.caching = True {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.152990 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] token.caching = True {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.153073 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.153224 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.153304 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] token.provider = fernet {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.153458 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.153537 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] token.provider = fernet {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.153691 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.153772 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.153967 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.154051 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.154205 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.154286 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.154436 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.154518 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.154678 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.154759 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.154918 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.155006 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] trust.driver = sql {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.155152 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.155233 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] trust.driver = sql {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.155385 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.155464 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.155616 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.155694 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.155846 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.155927 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.156087 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.156167 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.156315 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.156394 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.156557 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.156638 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.156798 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.156878 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.157085 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.157169 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] database.connection = **** {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.157328 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.157422 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] database.connection = **** {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.157573 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.157665 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.157808 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.157888 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.158070 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.158191 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.158306 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.158399 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.158540 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.158620 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.158773 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.158852 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.159005 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.159085 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.159238 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.159318 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.159472 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.159551 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.159704 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.159791 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.159938 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.160018 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.160170 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.160250 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.160435 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.160528 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.160634 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.160714 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.160862 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.160941 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.161091 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.161172 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.161322 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.161402 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.161494 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 09 16:25:38.161576 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 16:25:38.161706 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 09 16:25:38.193299 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=87275) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 16:25:38.193529 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=87275) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 16:25:38.194328 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=87275) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 16:25:38.196035 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=87276) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 16:25:38.196335 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=87276) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 16:25:38.196643 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=87276) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 16:25:38.202975 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=87275) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 16:25:38.207124 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=87276) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 16:25:38.231912 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=87275) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 16:25:38.232140 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=87275) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 16:25:38.235926 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=87276) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 16:25:38.236154 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=87276) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 16:25:38.285646 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=87275) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 16:25:38.288401 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=87276) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 16:25:38.334081 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=87275) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 16:25:38.334825 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=87275) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 16:25:38.334922 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=87276) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 16:25:38.335169 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=87276) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 16:25:38.398905 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87276) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 16:25:38.399128 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=87276) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 16:25:38.399235 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87275) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 16:25:38.399353 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=87276) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 16:25:38.399440 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=87275) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 16:25:38.399577 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=87275) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 16:25:38.399659 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=87276) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 16:25:38.399793 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=87276) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 16:25:38.399877 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=87275) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 16:25:38.400008 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=87276) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 16:25:38.400090 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=87275) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 16:25:38.400232 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=87275) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 16:25:38.425256 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87276) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 16:25:38.425486 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=87276) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 16:25:38.425617 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87275) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 16:25:38.425708 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=87276) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 16:25:38.425851 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=87275) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 16:25:38.426013 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=87276) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 16:25:38.426114 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=87275) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 16:25:38.426242 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=87276) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 16:25:38.426327 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=87275) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 16:25:38.426456 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=87276) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 16:25:38.426540 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=87275) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 16:25:38.426667 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87276) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 16:25:38.426752 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=87275) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 16:25:38.426896 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87275) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 16:25:38.437414 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=87276) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 16:25:38.437709 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=87275) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 16:25:38.451806 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87276) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 16:25:38.452064 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=87276) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 16:25:38.452217 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87275) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 16:25:38.452306 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=87276) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 16:25:38.452454 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=87275) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 16:25:38.452539 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=87276) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 16:25:38.452678 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=87275) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 16:25:38.452762 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=87276) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 16:25:38.452900 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=87275) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 16:25:38.452984 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=87276) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 16:25:38.453107 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87276) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 16:25:38.453199 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=87275) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 16:25:38.453322 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=87275) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 16:25:38.453535 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87275) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 16:25:38.470579 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=87276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 16:25:38.470787 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=87276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 09 16:25:38.471106 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=87275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 16:25:38.471321 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=87275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 09 16:25:38.471471 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=87276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 16:25:38.471664 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=87275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 16:25:38.471748 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=87276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 09 16:25:38.471871 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=87275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 09 16:25:38.471964 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=87276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 16:25:38.472147 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=87275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 16:25:38.472229 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=87276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 16:25:38.472413 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=87275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 16:25:38.472494 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=87276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 16:25:38.472704 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=87276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 16:25:38.472960 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=87275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 16:25:38.472960 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=87275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 16:25:38.482464 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=87276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 16:25:38.482743 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=87276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 16:25:38.482828 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=87275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 16:25:38.483016 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=87276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 16:25:38.483101 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=87275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 16:25:38.483301 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=87276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 16:25:38.483386 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=87275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 16:25:38.483587 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=87275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 16:25:38.490327 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=87276) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 16:25:38.490673 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=87275) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 16:25:38.493276 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=87276) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 16:25:38.493562 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=87276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 16:25:38.493649 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=87275) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 16:25:38.493844 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=87276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 16:25:38.493967 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=87275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 16:25:38.494151 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=87276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 16:25:38.494236 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=87275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 16:25:38.494435 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=87276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 16:25:38.494564 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=87275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 16:25:38.494699 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=87276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 16:25:38.494786 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=87275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 16:25:38.494970 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=87276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 16:25:38.495054 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=87275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 16:25:38.495242 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=87276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 16:25:38.495333 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=87275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 16:25:38.495512 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=87276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 16:25:38.495594 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=87275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 16:25:38.495786 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=87276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 16:25:38.495869 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=87275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 16:25:38.496054 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=87276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 16:25:38.496145 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=87275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 16:25:38.496341 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=87275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 16:25:38.519386 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=87276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 16:25:38.520004 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=87275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 16:25:38.520870 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=87276) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 16:25:38.521152 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=87276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 16:25:38.521490 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=87275) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 16:25:38.521828 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=87275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 16:25:38.526348 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=87276) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 16:25:38.526631 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=87276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 16:25:38.526912 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=87276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 16:25:38.526997 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=87275) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 16:25:38.527256 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=87275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 16:25:38.527544 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=87275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 16:25:38.533501 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=87276) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 16:25:38.533784 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=87276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 16:25:38.534116 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=87275) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 16:25:38.534404 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=87275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 16:25:38.537981 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=87276) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 16:25:38.538214 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=87276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 16:25:38.538497 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=87275) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 16:25:38.538592 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=87276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 16:25:38.538778 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=87276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 16:25:38.538863 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=87275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 16:25:38.539056 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=87276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 16:25:38.539141 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=87275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 16:25:38.539339 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=87275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 16:25:38.539450 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=87276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 16:25:38.539614 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=87275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 16:25:38.539741 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=87276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 16:25:38.539998 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=87275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 16:25:38.540081 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=87276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 16:25:38.540275 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=87275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 16:25:38.540549 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=87275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 16:25:38.555984 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=87276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 16:25:38.556260 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=87276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 16:25:38.556345 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=87275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 16:25:38.556617 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=87275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 16:25:38.560174 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=87276) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 16:25:38.560551 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=87275) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 16:25:38.563375 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=87276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 16:25:38.563922 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=87276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 16:25:38.564026 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=87275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 16:25:38.564261 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=87275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 16:25:38.569128 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=87276) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 16:25:38.569230 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=87275) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 16:25:38.572357 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=87276) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 16:25:38.572462 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=87275) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 16:25:38.575525 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=87276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 16:25:38.575617 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=87275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 16:25:38.575827 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=87276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 16:25:38.575911 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=87275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 16:25:38.576126 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=87276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 16:25:38.576210 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=87275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 16:25:38.576412 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=87275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 16:25:38.576495 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=87276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 16:25:38.576690 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=87276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 16:25:38.576773 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=87275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 16:25:38.578248 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=87276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 16:25:38.578337 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=87275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 16:25:38.700684 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=87275) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 16:25:38.700988 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=87275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 16:25:38.701161 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=87276) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 16:25:38.701285 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=87275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 16:25:38.701470 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=87276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 16:25:38.701554 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=87275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 16:25:38.701745 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=87276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 16:25:38.702030 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=87276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 16:25:38.708347 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=87275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 16:25:38.708872 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=87276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 16:25:38.710740 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=87275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 16:25:38.711022 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=87275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 16:25:38.711276 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=87276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 16:25:38.711553 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=87276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 16:25:38.713697 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=87275) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 16:25:38.714009 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=87275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 16:25:38.714242 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=87276) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 16:25:38.714333 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=87275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 16:25:38.714530 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=87276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 16:25:38.714630 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=87275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 16:25:38.714811 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=87276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 16:25:38.714894 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=87275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 16:25:38.715091 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=87276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 16:25:38.715367 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=87276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 16:25:38.726152 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=87275) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 16:25:38.726433 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=87275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 16:25:38.726718 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=87275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 16:25:38.726835 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=87276) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 16:25:38.727003 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=87275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 16:25:38.727117 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=87276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 16:25:38.727287 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=87275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 16:25:38.727398 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=87276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 16:25:38.727565 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=87275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 16:25:38.727680 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=87276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 16:25:38.727850 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=87275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 16:25:38.727962 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=87276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 16:25:38.728239 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=87276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 16:25:38.728515 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=87276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 16:25:38.743392 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=87275) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 16:25:38.744034 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=87276) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 16:25:38.746349 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=87275) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 16:25:38.747041 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=87276) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 16:25:38.749387 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=87275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 16:25:38.750086 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=87276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 16:25:38.750863 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=87275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 16:25:38.751534 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=87276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 16:25:38.752335 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=87275) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 16:25:38.752618 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=87275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 16:25:38.752903 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=87275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 16:25:38.752986 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=87276) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 16:25:38.753273 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=87276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 16:25:38.753557 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=87276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 16:25:38.760275 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=87275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 16:25:38.760739 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=87276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 16:25:38.761763 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=87275) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 16:25:38.762263 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=87276) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 16:25:38.765093 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=87275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 16:25:38.765093 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=87275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 16:25:38.765248 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=87276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 16:25:38.765326 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=87275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 16:25:38.765448 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=87276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 16:25:38.765561 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=87275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 16:25:38.765735 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=87276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 16:25:38.766060 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=87276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 16:25:38.774292 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=87275) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 16:25:38.774588 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=87275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 16:25:38.774803 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=87276) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 16:25:38.774898 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=87275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 16:25:38.775096 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=87276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 16:25:38.775374 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=87276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 16:25:38.781733 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=87275) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 16:25:38.782152 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=87275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 16:25:38.782238 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=87276) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 16:25:38.782438 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=87275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 16:25:38.782601 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=87276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 16:25:38.782718 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=87275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 16:25:38.782888 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=87276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 16:25:38.782995 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=87275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 16:25:38.783171 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=87276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 16:25:38.783274 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=87275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 16:25:38.783457 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=87276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 16:25:38.783547 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=87275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 16:25:38.783737 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=87276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 16:25:38.783819 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=87275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 16:25:38.784017 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=87276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 16:25:38.784108 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=87275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 16:25:38.784307 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=87276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 16:25:38.784391 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=87275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 16:25:38.784583 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=87276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 16:25:38.784666 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=87275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 16:25:38.784857 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=87276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 16:25:38.784948 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=87275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 16:25:38.785131 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=87276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 16:25:38.785213 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=87275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 16:25:38.785402 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=87275) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 16:25:38.785483 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=87276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 16:25:38.785666 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=87276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 16:25:38.785953 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=87276) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 16:25:38.820144 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55963fbc49c0 pid: 87275 (default app) Aug 09 16:25:38.820502 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55963fbc49c0 pid: 87276 (default app) Aug 09 16:25:38.823665 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ceacdb-cb57-4982-af87-03e529cb01cb None None] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:25:38.823953 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ceacdb-cb57-4982-af87-03e529cb01cb None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:25:38.824226 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ceacdb-cb57-4982-af87-03e529cb01cb None None] PATH_INFO: `/v3` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:25:38.828369 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 1/1] 10.222.0.104 () {50 vars in 796 bytes} [Tue Aug 9 16:25:38 2022] GET /identity/v3/ => generated 256 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:25:47.040056 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f28ce3-4020-4992-a75f-8e5ba949f1fa None None] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:25:47.040594 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f28ce3-4020-4992-a75f-8e5ba949f1fa None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:25:47.040594 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f28ce3-4020-4992-a75f-8e5ba949f1fa None None] PATH_INFO: `/` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:25:47.044776 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 1/2] 10.222.0.104 () {54 vars in 932 bytes} [Tue Aug 9 16:25:47 2022] GET /identity => generated 271 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:25:47.050049 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b2ea56-1198-4255-9baf-aae2a45b1b4b None None] REQUEST_METHOD: `POST` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:25:47.050490 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b2ea56-1198-4255-9baf-aae2a45b1b4b None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:25:47.050490 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b2ea56-1198-4255-9baf-aae2a45b1b4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:25:47.127736 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: INFO dbcounter [None req-b6b2ea56-1198-4255-9baf-aae2a45b1b4b None None] Registered counter for database keystone Aug 09 16:25:47.147276 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG oslo_db.sqlalchemy.engines [None req-b6b2ea56-1198-4255-9baf-aae2a45b1b4b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87275) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 16:25:47.153540 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writer thread running {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 16:25:47.331670 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG passlib.handlers.bcrypt [None req-b6b2ea56-1198-4255-9baf-aae2a45b1b4b None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=87275) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 09 16:25:47.332013 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG passlib.handlers.bcrypt [None req-b6b2ea56-1198-4255-9baf-aae2a45b1b4b None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=87275) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 09 16:25:47.386692 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.auth.core [None req-b6b2ea56-1198-4255-9baf-aae2a45b1b4b None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:25:47.388258 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.fernet_utils [None req-b6b2ea56-1198-4255-9baf-aae2a45b1b4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:25:47.517016 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 2/3] 10.222.0.104 () {58 vars in 1029 bytes} [Tue Aug 9 16:25:47 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 468 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 09 16:25:47.661634 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f28ce3-4020-4992-a75f-8e5ba949f1fa None None] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:25:47.737619 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: INFO dbcounter [None req-91f28ce3-4020-4992-a75f-8e5ba949f1fa None None] Registered counter for database keystone Aug 09 16:25:47.759412 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG oslo_db.sqlalchemy.engines [None req-91f28ce3-4020-4992-a75f-8e5ba949f1fa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87276) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 16:25:47.765743 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writer thread running {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 16:25:47.885295 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f28ce3-4020-4992-a75f-8e5ba949f1fa None None] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:25:47.889617 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe48fa71-3597-4fd0-b880-db2c3980f3fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce95c8faa1d4165b111ca9c55852804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:25:47.890271 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe48fa71-3597-4fd0-b880-db2c3980f3fc admin admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:25:47.890550 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe48fa71-3597-4fd0-b880-db2c3980f3fc admin admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:25:47.890821 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe48fa71-3597-4fd0-b880-db2c3980f3fc admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:25:47.899157 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe48fa71-3597-4fd0-b880-db2c3980f3fc admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:25:47.949738 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: WARNING keystone.common.rbac_enforcer.enforcer [None req-fe48fa71-3597-4fd0-b880-db2c3980f3fc admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 09 16:25:47.950052 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe48fa71-3597-4fd0-b880-db2c3980f3fc admin admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:25:47.960032 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 2/4] 10.222.0.104 () {58 vars in 1329 bytes} [Tue Aug 9 16:25:47 2022] GET /identity/v3/auth/tokens => generated 915 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 09 16:25:47.966033 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b2ea56-1198-4255-9baf-aae2a45b1b4b None None] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:25:47.981181 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b2ea56-1198-4255-9baf-aae2a45b1b4b None None] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:25:47.985557 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55199e49-8cba-4c73-925e-47266d39f784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce95c8faa1d4165b111ca9c55852804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:25:47.986686 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55199e49-8cba-4c73-925e-47266d39f784 admin admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:25:47.986965 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55199e49-8cba-4c73-925e-47266d39f784 admin admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:25:47.987244 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55199e49-8cba-4c73-925e-47266d39f784 admin admin] PATH_INFO: `/v3/projects/7ce95c8faa1d4165b111ca9c55852804` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:25:47.988804 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55199e49-8cba-4c73-925e-47266d39f784 admin admin] RBAC: Authorizing `identity:get_project(project_id=7ce95c8faa1d4165b111ca9c55852804)` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:25:48.040654 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: WARNING keystone.common.rbac_enforcer.enforcer [None req-55199e49-8cba-4c73-925e-47266d39f784 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 09 16:25:48.040993 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55199e49-8cba-4c73-925e-47266d39f784 admin admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:25:48.045500 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 3/5] 10.222.0.104 () {56 vars in 1212 bytes} [Tue Aug 9 16:25:47 2022] GET /identity/v3/projects/7ce95c8faa1d4165b111ca9c55852804 => generated 345 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:25:50.319143 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed67c30-9da7-4a60-9e9c-ac0460c1b2cf None None] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:25:50.319689 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed67c30-9da7-4a60-9e9c-ac0460c1b2cf None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:25:50.319689 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed67c30-9da7-4a60-9e9c-ac0460c1b2cf None None] PATH_INFO: `/` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:25:50.323797 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 3/6] 10.222.0.104 () {54 vars in 932 bytes} [Tue Aug 9 16:25:50 2022] GET /identity => generated 271 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:25:50.329249 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94101d01-7f55-4963-9fcc-ad7eb5fb0c37 None None] REQUEST_METHOD: `POST` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:25:50.329656 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94101d01-7f55-4963-9fcc-ad7eb5fb0c37 None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:25:50.329793 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94101d01-7f55-4963-9fcc-ad7eb5fb0c37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:25:50.351453 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.auth.core [None req-94101d01-7f55-4963-9fcc-ad7eb5fb0c37 None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:25:50.352965 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.fernet_utils [None req-94101d01-7f55-4963-9fcc-ad7eb5fb0c37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:25:50.360886 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 4/7] 10.222.0.104 () {58 vars in 1029 bytes} [Tue Aug 9 16:25:50 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 09 16:25:50.387567 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed67c30-9da7-4a60-9e9c-ac0460c1b2cf None None] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:25:50.399790 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed67c30-9da7-4a60-9e9c-ac0460c1b2cf None None] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:25:50.404061 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fedb12-762a-4bae-9e21-bc1c8f6cdfd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce95c8faa1d4165b111ca9c55852804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:25:50.404656 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fedb12-762a-4bae-9e21-bc1c8f6cdfd8 admin admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:25:50.404932 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fedb12-762a-4bae-9e21-bc1c8f6cdfd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:25:50.405203 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fedb12-762a-4bae-9e21-bc1c8f6cdfd8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:25:50.413931 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fedb12-762a-4bae-9e21-bc1c8f6cdfd8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:25:50.416035 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fedb12-762a-4bae-9e21-bc1c8f6cdfd8 admin admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:25:50.424947 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 4/8] 10.222.0.104 () {58 vars in 1329 bytes} [Tue Aug 9 16:25:50 2022] GET /identity/v3/auth/tokens => generated 915 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 09 16:25:50.431118 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94101d01-7f55-4963-9fcc-ad7eb5fb0c37 None None] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:25:50.440456 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94101d01-7f55-4963-9fcc-ad7eb5fb0c37 None None] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:25:50.444976 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a996dd9e-dbd0-490a-9ee0-c8d97ff56587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce95c8faa1d4165b111ca9c55852804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:25:50.445600 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a996dd9e-dbd0-490a-9ee0-c8d97ff56587 admin admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:25:50.445882 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a996dd9e-dbd0-490a-9ee0-c8d97ff56587 admin admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:25:50.446188 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a996dd9e-dbd0-490a-9ee0-c8d97ff56587 admin admin] PATH_INFO: `/v3/users/cd0c59114b4e47af86cbee7e2a704cf6` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:25:50.447513 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a996dd9e-dbd0-490a-9ee0-c8d97ff56587 admin admin] RBAC: Authorizing `identity:get_user(user_id=cd0c59114b4e47af86cbee7e2a704cf6)` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:25:50.449340 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a996dd9e-dbd0-490a-9ee0-c8d97ff56587 admin admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:25:50.450914 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 5/9] 10.222.0.104 () {56 vars in 1203 bytes} [Tue Aug 9 16:25:50 2022] GET /identity/v3/users/cd0c59114b4e47af86cbee7e2a704cf6 => generated 248 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:25:52.834141 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466318cd-d768-45ec-a982-57faf3203a3f None None] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:25:52.834669 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466318cd-d768-45ec-a982-57faf3203a3f None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:25:52.834669 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466318cd-d768-45ec-a982-57faf3203a3f None None] PATH_INFO: `/` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:25:52.835990 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 5/10] 10.222.0.104 () {54 vars in 932 bytes} [Tue Aug 9 16:25:52 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:25:52.838663 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd24c6df-3401-488d-b25c-51ebb27bc6be None None] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:25:52.839052 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd24c6df-3401-488d-b25c-51ebb27bc6be None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:25:52.839222 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd24c6df-3401-488d-b25c-51ebb27bc6be None None] PATH_INFO: `/` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:25:52.840741 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69248e06-1263-4326-a2b0-21472bc312c4 None None] REQUEST_METHOD: `POST` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:25:52.841153 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69248e06-1263-4326-a2b0-21472bc312c4 None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:25:52.841259 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 6/11] 10.222.0.104 () {54 vars in 932 bytes} [Tue Aug 9 16:25:52 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 09 16:25:52.841343 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69248e06-1263-4326-a2b0-21472bc312c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:25:52.845820 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f291ba39-49e3-4d14-87eb-675b10b9994f None None] REQUEST_METHOD: `POST` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:25:52.846160 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f291ba39-49e3-4d14-87eb-675b10b9994f None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:25:52.846595 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f291ba39-49e3-4d14-87eb-675b10b9994f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:25:52.865226 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.auth.core [None req-f291ba39-49e3-4d14-87eb-675b10b9994f None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:25:52.866428 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.fernet_utils [None req-f291ba39-49e3-4d14-87eb-675b10b9994f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:25:52.884346 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG passlib.handlers.bcrypt [None req-69248e06-1263-4326-a2b0-21472bc312c4 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=87276) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 09 16:25:52.884768 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG passlib.handlers.bcrypt [None req-69248e06-1263-4326-a2b0-21472bc312c4 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=87276) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 09 16:25:52.930603 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.auth.core [None req-69248e06-1263-4326-a2b0-21472bc312c4 None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:25:52.932167 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.fernet_utils [None req-69248e06-1263-4326-a2b0-21472bc312c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:25:52.945097 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 7/12] 10.222.0.104 () {58 vars in 1029 bytes} [Tue Aug 9 16:25:52 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 16:25:52.969262 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f291ba39-49e3-4d14-87eb-675b10b9994f None None] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:25:52.993855 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:25:53.033554 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 6/13] 10.222.0.104 () {58 vars in 1029 bytes} [Tue Aug 9 16:25:52 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 16:25:53.058313 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69248e06-1263-4326-a2b0-21472bc312c4 None None] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:25:53.075384 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f291ba39-49e3-4d14-87eb-675b10b9994f None None] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:25:53.107950 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b81d73-13c2-44ec-8776-07bd0b080055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:25:53.108564 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b81d73-13c2-44ec-8776-07bd0b080055 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:25:53.108842 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b81d73-13c2-44ec-8776-07bd0b080055 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:25:53.109115 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b81d73-13c2-44ec-8776-07bd0b080055 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:25:53.161650 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69248e06-1263-4326-a2b0-21472bc312c4 None None] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:25:53.164357 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:25:53.179008 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b81d73-13c2-44ec-8776-07bd0b080055 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:25:53.180580 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b81d73-13c2-44ec-8776-07bd0b080055 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:25:53.200411 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7662f01-6aad-4636-80dc-20383fcf8f38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:25:53.201739 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7662f01-6aad-4636-80dc-20383fcf8f38 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:25:53.202063 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7662f01-6aad-4636-80dc-20383fcf8f38 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:25:53.202332 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7662f01-6aad-4636-80dc-20383fcf8f38 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:25:53.203467 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:25:53.216679 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7662f01-6aad-4636-80dc-20383fcf8f38 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 16:25:53.225239 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application [None req-a7662f01-6aad-4636-80dc-20383fcf8f38 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 16:25:53.225239 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:25:53.225239 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:25:53.225239 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:25:53.225239 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:25:53.225239 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:25:53.225239 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:25:53.225239 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:25:53.225239 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:25:53.225239 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:25:53.225239 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:25:53.225239 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:25:53.225239 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 16:25:53.225239 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 16:25:53.225239 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 16:25:53.225239 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 16:25:53.226318 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 16:25:53.226318 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 16:25:53.226318 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 16:25:53.226318 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 16:25:53.226318 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:25:53.226318 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:25:53.226318 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:25:53.226318 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:25:53.226318 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:25:53.226318 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:25:53.226318 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:25:53.226318 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application with Lock( Aug 09 16:25:53.226318 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:25:53.226318 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:25:53.226318 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:25:53.226318 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:25:53.227152 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:25:53.227152 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:25:53.227152 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:25:53.227152 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:25:53.227152 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 16:25:53.227152 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 16:25:53.227152 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 16:25:53.227152 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 16:25:53.227152 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 16:25:53.227152 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 16:25:53.227152 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 16:25:53.227152 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Aug 09 16:25:53.227152 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 7/14] 10.222.0.104 () {56 vars in 1101 bytes} [Tue Aug 9 16:25:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 16:25:53.232060 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7662f01-6aad-4636-80dc-20383fcf8f38 None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:25:53.279464 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 8/15] 10.222.0.104 () {58 vars in 1287 bytes} [Tue Aug 9 16:25:52 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 09 16:25:53.285239 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b81d73-13c2-44ec-8776-07bd0b080055 None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:25:53.332002 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7662f01-6aad-4636-80dc-20383fcf8f38 None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:25:53.364858 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad405ac0-7c6e-49a7-b75b-ab9dbfc346fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:25:53.365455 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad405ac0-7c6e-49a7-b75b-ab9dbfc346fa None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:25:53.365730 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad405ac0-7c6e-49a7-b75b-ab9dbfc346fa None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:25:53.366182 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad405ac0-7c6e-49a7-b75b-ab9dbfc346fa None admin] PATH_INFO: `/v3/roles` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:25:53.366848 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad405ac0-7c6e-49a7-b75b-ab9dbfc346fa None admin] RBAC: Adding query filter params (name=admin) {{(pid=87276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:25:53.367147 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad405ac0-7c6e-49a7-b75b-ab9dbfc346fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:25:53.368723 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad405ac0-7c6e-49a7-b75b-ab9dbfc346fa None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:25:53.381258 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 8/16] 10.222.0.104 () {56 vars in 1104 bytes} [Tue Aug 9 16:25:53 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 16:25:53.382069 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b81d73-13c2-44ec-8776-07bd0b080055 None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:25:53.386747 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad405ac0-7c6e-49a7-b75b-ab9dbfc346fa None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:25:53.403993 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:25:53.414009 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:25:53.416781 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046b69bf-a7b6-4850-ae15-00f3f8fac5ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:25:53.417412 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046b69bf-a7b6-4850-ae15-00f3f8fac5ed None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:25:53.417695 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046b69bf-a7b6-4850-ae15-00f3f8fac5ed None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:25:53.418002 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046b69bf-a7b6-4850-ae15-00f3f8fac5ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:25:53.428581 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046b69bf-a7b6-4850-ae15-00f3f8fac5ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:25:53.430073 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046b69bf-a7b6-4850-ae15-00f3f8fac5ed None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:25:53.448370 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application [None req-046b69bf-a7b6-4850-ae15-00f3f8fac5ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 16:25:53.448370 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:25:53.448370 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:25:53.448370 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:25:53.448370 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:25:53.448370 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:25:53.448370 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:25:53.448370 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:25:53.448370 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:25:53.448370 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:25:53.448370 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:25:53.448370 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:25:53.448370 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 16:25:53.448370 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 16:25:53.448370 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 16:25:53.448370 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 16:25:53.449388 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:25:53.449388 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:25:53.449388 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:25:53.449388 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:25:53.449388 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:25:53.449388 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:25:53.449388 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:25:53.449388 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application with Lock( Aug 09 16:25:53.449388 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:25:53.449388 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:25:53.449388 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:25:53.449388 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:25:53.449388 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:25:53.449388 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:25:53.449388 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:25:53.449388 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:25:53.449388 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 16:25:53.450363 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 16:25:53.450363 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 16:25:53.450363 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Aug 09 16:25:53.450363 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 9/17] 10.222.0.104 () {56 vars in 1113 bytes} [Tue Aug 9 16:25:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 16:25:53.455278 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046b69bf-a7b6-4850-ae15-00f3f8fac5ed None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:25:53.489060 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad405ac0-7c6e-49a7-b75b-ab9dbfc346fa None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:25:53.523625 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f75678-ad02-4991-b934-1efff2dd0b01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:25:53.524251 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f75678-ad02-4991-b934-1efff2dd0b01 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:25:53.524527 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f75678-ad02-4991-b934-1efff2dd0b01 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:25:53.524798 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f75678-ad02-4991-b934-1efff2dd0b01 None admin] PATH_INFO: `/v3/users/cd0c59114b4e47af86cbee7e2a704cf6` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:25:53.526372 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f75678-ad02-4991-b934-1efff2dd0b01 None admin] RBAC: Authorizing `identity:get_user(user_id=cd0c59114b4e47af86cbee7e2a704cf6)` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:25:53.527823 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f75678-ad02-4991-b934-1efff2dd0b01 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:25:53.529394 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 9/18] 10.222.0.104 () {56 vars in 1182 bytes} [Tue Aug 9 16:25:53 2022] GET /identity/v3/users/cd0c59114b4e47af86cbee7e2a704cf6 => generated 248 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 16:25:53.534917 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f75678-ad02-4991-b934-1efff2dd0b01 None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:25:53.553972 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046b69bf-a7b6-4850-ae15-00f3f8fac5ed None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:25:53.588125 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cdacdc-87f0-4198-82e7-edbbdb69882b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:25:53.588735 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cdacdc-87f0-4198-82e7-edbbdb69882b None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:25:53.589010 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cdacdc-87f0-4198-82e7-edbbdb69882b None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:25:53.589282 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cdacdc-87f0-4198-82e7-edbbdb69882b None admin] PATH_INFO: `/v3/domains` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:25:53.589949 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cdacdc-87f0-4198-82e7-edbbdb69882b None admin] RBAC: Adding query filter params (name=Default) {{(pid=87275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:25:53.590253 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cdacdc-87f0-4198-82e7-edbbdb69882b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:25:53.591629 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cdacdc-87f0-4198-82e7-edbbdb69882b None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:25:53.609495 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 10/19] 10.222.0.104 () {56 vars in 1114 bytes} [Tue Aug 9 16:25:53 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 16:25:53.632196 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:25:53.639859 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f75678-ad02-4991-b934-1efff2dd0b01 None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:25:53.681156 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51307882-b733-4bde-930f-ef369102dd57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:25:53.681806 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51307882-b733-4bde-930f-ef369102dd57 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:25:53.682116 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51307882-b733-4bde-930f-ef369102dd57 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:25:53.682392 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51307882-b733-4bde-930f-ef369102dd57 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:25:53.683549 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51307882-b733-4bde-930f-ef369102dd57 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:25:53.685021 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51307882-b733-4bde-930f-ef369102dd57 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:25:53.686674 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 10/20] 10.222.0.104 () {56 vars in 1113 bytes} [Tue Aug 9 16:25:53 2022] GET /identity/v3/domains/default => generated 200 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 16:25:53.693271 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cdacdc-87f0-4198-82e7-edbbdb69882b None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:25:53.729750 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:25:53.804143 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cdacdc-87f0-4198-82e7-edbbdb69882b None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:25:53.839298 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6816b004-3ee1-4674-b14e-7212533d45c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:25:53.839911 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6816b004-3ee1-4674-b14e-7212533d45c1 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:25:53.840187 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6816b004-3ee1-4674-b14e-7212533d45c1 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:25:53.840463 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6816b004-3ee1-4674-b14e-7212533d45c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:25:53.841187 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6816b004-3ee1-4674-b14e-7212533d45c1 None admin] RBAC: Adding query filter params (role.id=c0143e35c1344a39a931bbb6bcd5acdc, scope.domain.id=default, user.id=cd0c59114b4e47af86cbee7e2a704cf6) {{(pid=87275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:25:53.841495 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6816b004-3ee1-4674-b14e-7212533d45c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:25:53.844679 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6816b004-3ee1-4674-b14e-7212533d45c1 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:25:53.849797 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 11/21] 10.222.0.104 () {56 vars in 1327 bytes} [Tue Aug 9 16:25:53 2022] GET /identity/v3/role_assignments?user.id=cd0c59114b4e47af86cbee7e2a704cf6&scope.domain.id=default&role.id=c0143e35c1344a39a931bbb6bcd5acdc => generated 234 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 16:25:56.456516 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bd62fb-afc6-4e3a-ab5a-6a0670cf1f03 None None] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:25:56.458202 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bd62fb-afc6-4e3a-ab5a-6a0670cf1f03 None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:25:56.458718 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bd62fb-afc6-4e3a-ab5a-6a0670cf1f03 None None] PATH_INFO: `/` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:25:56.460322 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 11/22] 10.222.0.104 () {54 vars in 932 bytes} [Tue Aug 9 16:25:56 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:25:56.466487 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f543270-79b1-4c19-81fe-e1af93122652 None None] REQUEST_METHOD: `POST` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:25:56.467454 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f543270-79b1-4c19-81fe-e1af93122652 None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:25:56.467919 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f543270-79b1-4c19-81fe-e1af93122652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:25:56.493330 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.auth.core [None req-1f543270-79b1-4c19-81fe-e1af93122652 None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:25:56.495005 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.fernet_utils [None req-1f543270-79b1-4c19-81fe-e1af93122652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:25:56.584250 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 12/23] 10.222.0.104 () {58 vars in 1029 bytes} [Tue Aug 9 16:25:56 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 16:25:56.619177 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bd62fb-afc6-4e3a-ab5a-6a0670cf1f03 None None] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:25:56.684082 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc657a17-1799-429b-ae00-d250e21affc1 None None] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:25:56.684730 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc657a17-1799-429b-ae00-d250e21affc1 None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:25:56.685204 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc657a17-1799-429b-ae00-d250e21affc1 None None] PATH_INFO: `/` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:25:56.686844 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 13/24] 10.222.0.104 () {54 vars in 932 bytes} [Tue Aug 9 16:25:56 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:25:56.694520 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acb836d-a64d-4c5e-9d3c-798158c2f338 None None] REQUEST_METHOD: `POST` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:25:56.695136 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acb836d-a64d-4c5e-9d3c-798158c2f338 None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:25:56.695604 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acb836d-a64d-4c5e-9d3c-798158c2f338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:25:56.721438 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.auth.core [None req-3acb836d-a64d-4c5e-9d3c-798158c2f338 None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:25:56.724435 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.fernet_utils [None req-3acb836d-a64d-4c5e-9d3c-798158c2f338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:25:56.783447 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:25:56.820784 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bd62fb-afc6-4e3a-ab5a-6a0670cf1f03 None None] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:25:56.874456 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 14/25] 10.222.0.104 () {58 vars in 1029 bytes} [Tue Aug 9 16:25:56 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 16:25:56.875716 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a0ac90-8675-4b53-9069-2cb387f7e83e None None] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:25:56.875996 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a0ac90-8675-4b53-9069-2cb387f7e83e None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:25:56.876266 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a0ac90-8675-4b53-9069-2cb387f7e83e None None] PATH_INFO: `/` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:25:56.877728 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 15/26] 10.222.0.104 () {54 vars in 932 bytes} [Tue Aug 9 16:25:56 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:25:56.885778 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbc7b02-db07-426d-a7a3-fa2cf3fa2dda None None] REQUEST_METHOD: `POST` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:25:56.886072 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbc7b02-db07-426d-a7a3-fa2cf3fa2dda None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:25:56.886345 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbc7b02-db07-426d-a7a3-fa2cf3fa2dda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:25:56.895513 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880b36b8-18a4-4158-b129-3532cae6b384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:25:56.896121 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880b36b8-18a4-4158-b129-3532cae6b384 None admin] REQUEST_METHOD: `POST` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:25:56.896398 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880b36b8-18a4-4158-b129-3532cae6b384 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:25:56.896694 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880b36b8-18a4-4158-b129-3532cae6b384 None admin] PATH_INFO: `/v3/roles` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:25:56.897340 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880b36b8-18a4-4158-b129-3532cae6b384 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:25:56.898740 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880b36b8-18a4-4158-b129-3532cae6b384 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:25:56.921383 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.auth.core [None req-adbc7b02-db07-426d-a7a3-fa2cf3fa2dda None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:25:56.923030 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.fernet_utils [None req-adbc7b02-db07-426d-a7a3-fa2cf3fa2dda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:25:57.024554 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 16/27] 10.222.0.104 () {58 vars in 1029 bytes} [Tue Aug 9 16:25:56 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 16:25:57.025602 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbc7b02-db07-426d-a7a3-fa2cf3fa2dda None None] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:25:57.060797 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 12/28] 10.222.0.104 () {60 vars in 1136 bytes} [Tue Aug 9 16:25:56 2022] POST /identity/v3/roles => generated 220 bytes in 442 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 16:25:57.068049 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880b36b8-18a4-4158-b129-3532cae6b384 None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:25:57.117431 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:25:57.130957 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:25:57.170650 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbc7b02-db07-426d-a7a3-fa2cf3fa2dda None None] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:25:57.278425 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b9fddb-65b2-4ed7-99af-c255e6350c04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:25:57.279734 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b9fddb-65b2-4ed7-99af-c255e6350c04 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:25:57.280381 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b9fddb-65b2-4ed7-99af-c255e6350c04 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:25:57.281152 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b9fddb-65b2-4ed7-99af-c255e6350c04 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:25:57.313716 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b9fddb-65b2-4ed7-99af-c255e6350c04 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 16:25:57.321046 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application [None req-31b9fddb-65b2-4ed7-99af-c255e6350c04 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 16:25:57.321046 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:25:57.321046 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:25:57.321046 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:25:57.321046 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:25:57.321046 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:25:57.321046 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:25:57.321046 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:25:57.321046 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:25:57.321046 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:25:57.321046 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:25:57.321046 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:25:57.321046 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 16:25:57.321046 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 16:25:57.321046 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 16:25:57.321046 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 16:25:57.321984 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 16:25:57.321984 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 16:25:57.321984 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 16:25:57.321984 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 16:25:57.321984 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:25:57.321984 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:25:57.321984 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:25:57.321984 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:25:57.321984 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:25:57.321984 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:25:57.321984 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:25:57.321984 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application with Lock( Aug 09 16:25:57.321984 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:25:57.321984 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:25:57.321984 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:25:57.321984 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:25:57.322748 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:25:57.322748 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:25:57.322748 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:25:57.322748 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:25:57.322748 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 16:25:57.322748 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 16:25:57.322748 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 16:25:57.322748 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 16:25:57.322748 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 16:25:57.322748 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 16:25:57.322748 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 16:25:57.322748 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Aug 09 16:25:57.322748 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 17/29] 10.222.0.104 () {56 vars in 1101 bytes} [Tue Aug 9 16:25:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 16:25:57.329866 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b9fddb-65b2-4ed7-99af-c255e6350c04 None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:25:57.342850 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880b36b8-18a4-4158-b129-3532cae6b384 None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:25:57.420478 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ae6ff2-3d24-420e-b72e-25690dd62af5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:25:57.421136 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ae6ff2-3d24-420e-b72e-25690dd62af5 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:25:57.421422 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ae6ff2-3d24-420e-b72e-25690dd62af5 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:25:57.421763 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ae6ff2-3d24-420e-b72e-25690dd62af5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:25:57.443666 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ae6ff2-3d24-420e-b72e-25690dd62af5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:25:57.445537 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ae6ff2-3d24-420e-b72e-25690dd62af5 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:25:57.451387 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b9fddb-65b2-4ed7-99af-c255e6350c04 None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:25:57.462665 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application [None req-24ae6ff2-3d24-420e-b72e-25690dd62af5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 16:25:57.462665 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:25:57.462665 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:25:57.462665 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:25:57.462665 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:25:57.462665 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:25:57.462665 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:25:57.462665 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:25:57.462665 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:25:57.462665 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:25:57.462665 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:25:57.462665 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:25:57.462665 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 16:25:57.462665 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 16:25:57.462665 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 16:25:57.462665 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 16:25:57.463876 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:25:57.463876 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:25:57.463876 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:25:57.463876 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:25:57.463876 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:25:57.463876 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:25:57.463876 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:25:57.463876 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application with Lock( Aug 09 16:25:57.463876 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:25:57.463876 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:25:57.463876 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:25:57.463876 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:25:57.463876 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:25:57.463876 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:25:57.463876 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:25:57.463876 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:25:57.463876 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 16:25:57.464651 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 16:25:57.464651 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 16:25:57.464651 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Aug 09 16:25:57.464651 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 13/30] 10.222.0.104 () {56 vars in 1113 bytes} [Tue Aug 9 16:25:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 397 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 16:25:57.467990 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7736db4e-8595-4656-b0ca-f17efe59b1b9 None None] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:25:57.467990 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7736db4e-8595-4656-b0ca-f17efe59b1b9 None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:25:57.467990 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7736db4e-8595-4656-b0ca-f17efe59b1b9 None None] PATH_INFO: `/` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:25:57.467990 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 14/31] 10.222.0.104 () {54 vars in 932 bytes} [Tue Aug 9 16:25:57 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:25:57.474046 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef895c7-3cc6-44e8-9e59-e0046247adf6 None None] REQUEST_METHOD: `POST` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:25:57.474438 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef895c7-3cc6-44e8-9e59-e0046247adf6 None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:25:57.474715 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef895c7-3cc6-44e8-9e59-e0046247adf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:25:57.496423 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.auth.core [None req-eef895c7-3cc6-44e8-9e59-e0046247adf6 None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:25:57.497678 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc258401-9fa8-4c19-9c71-0488ab4ff3b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:25:57.498248 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.fernet_utils [None req-eef895c7-3cc6-44e8-9e59-e0046247adf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:25:57.498418 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc258401-9fa8-4c19-9c71-0488ab4ff3b5 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:25:57.498635 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc258401-9fa8-4c19-9c71-0488ab4ff3b5 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:25:57.498946 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc258401-9fa8-4c19-9c71-0488ab4ff3b5 None admin] PATH_INFO: `/v3/roles` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:25:57.499652 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc258401-9fa8-4c19-9c71-0488ab4ff3b5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:25:57.499995 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc258401-9fa8-4c19-9c71-0488ab4ff3b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:25:57.501508 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc258401-9fa8-4c19-9c71-0488ab4ff3b5 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:25:57.515091 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 18/32] 10.222.0.104 () {56 vars in 1104 bytes} [Tue Aug 9 16:25:57 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 16:25:57.516020 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc258401-9fa8-4c19-9c71-0488ab4ff3b5 None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:25:57.534481 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:25:57.592434 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 15/33] 10.222.0.104 () {58 vars in 1029 bytes} [Tue Aug 9 16:25:57 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 16:25:57.593378 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef895c7-3cc6-44e8-9e59-e0046247adf6 None None] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:25:57.604001 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:25:57.672557 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc258401-9fa8-4c19-9c71-0488ab4ff3b5 None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:25:57.720319 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a826af-1132-4938-800d-36996526c1a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:25:57.721399 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a826af-1132-4938-800d-36996526c1a7 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:25:57.721799 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a826af-1132-4938-800d-36996526c1a7 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:25:57.722110 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a826af-1132-4938-800d-36996526c1a7 None admin] PATH_INFO: `/v3/domains` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:25:57.722759 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a826af-1132-4938-800d-36996526c1a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:25:57.723264 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a826af-1132-4938-800d-36996526c1a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:25:57.725225 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a826af-1132-4938-800d-36996526c1a7 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:25:57.729843 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef895c7-3cc6-44e8-9e59-e0046247adf6 None None] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:25:57.739850 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 19/34] 10.222.0.104 () {56 vars in 1114 bytes} [Tue Aug 9 16:25:57 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:25:57.740690 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a826af-1132-4938-800d-36996526c1a7 None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:25:57.779627 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78790f13-42bd-41f6-a2f1-d93ffc03f177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:25:57.780599 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78790f13-42bd-41f6-a2f1-d93ffc03f177 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:25:57.781070 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78790f13-42bd-41f6-a2f1-d93ffc03f177 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:25:57.781505 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78790f13-42bd-41f6-a2f1-d93ffc03f177 None admin] PATH_INFO: `/v3/users/cd0c59114b4e47af86cbee7e2a704cf6` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:25:57.782880 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78790f13-42bd-41f6-a2f1-d93ffc03f177 None admin] RBAC: Authorizing `identity:get_user(user_id=cd0c59114b4e47af86cbee7e2a704cf6)` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:25:57.784659 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78790f13-42bd-41f6-a2f1-d93ffc03f177 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:25:57.786898 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 16/35] 10.222.0.104 () {56 vars in 1182 bytes} [Tue Aug 9 16:25:57 2022] GET /identity/v3/users/cd0c59114b4e47af86cbee7e2a704cf6 => generated 248 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:25:57.787879 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78790f13-42bd-41f6-a2f1-d93ffc03f177 None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:25:57.827286 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:25:57.862256 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:25:57.863147 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a826af-1132-4938-800d-36996526c1a7 None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:25:57.893796 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78790f13-42bd-41f6-a2f1-d93ffc03f177 None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:25:57.900430 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd39303-18e7-4c7f-b5a3-a84ea6331c44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:25:57.901045 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd39303-18e7-4c7f-b5a3-a84ea6331c44 None admin] REQUEST_METHOD: `POST` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:25:57.901326 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd39303-18e7-4c7f-b5a3-a84ea6331c44 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:25:57.901600 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd39303-18e7-4c7f-b5a3-a84ea6331c44 None admin] PATH_INFO: `/v3/roles` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:25:57.902296 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd39303-18e7-4c7f-b5a3-a84ea6331c44 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:25:57.903703 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd39303-18e7-4c7f-b5a3-a84ea6331c44 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:25:57.937054 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ff7faa-7681-4fc1-9be5-74250f113909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:25:57.938043 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ff7faa-7681-4fc1-9be5-74250f113909 None admin] REQUEST_METHOD: `POST` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:25:57.938381 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ff7faa-7681-4fc1-9be5-74250f113909 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:25:57.938662 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ff7faa-7681-4fc1-9be5-74250f113909 None admin] PATH_INFO: `/v3/projects` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:25:57.939662 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ff7faa-7681-4fc1-9be5-74250f113909 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:25:57.941108 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ff7faa-7681-4fc1-9be5-74250f113909 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:25:57.981925 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 17/36] 10.222.0.104 () {60 vars in 1146 bytes} [Tue Aug 9 16:25:57 2022] POST /identity/v3/projects => generated 302 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 16:25:57.981925 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ff7faa-7681-4fc1-9be5-74250f113909 None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:25:58.036193 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 20/37] 10.222.0.104 () {60 vars in 1136 bytes} [Tue Aug 9 16:25:57 2022] POST /identity/v3/roles => generated 226 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 16:25:58.037609 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3726cf0b-a271-4b5b-bac6-3329fa673ef4 None None] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:25:58.037910 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3726cf0b-a271-4b5b-bac6-3329fa673ef4 None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:25:58.038194 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3726cf0b-a271-4b5b-bac6-3329fa673ef4 None None] PATH_INFO: `/` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:25:58.039458 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 21/38] 10.222.0.104 () {54 vars in 932 bytes} [Tue Aug 9 16:25:58 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:25:58.045283 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbcaf8c-2d25-4ed8-8d5a-035cae5f655d None None] REQUEST_METHOD: `POST` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:25:58.045617 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbcaf8c-2d25-4ed8-8d5a-035cae5f655d None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:25:58.045835 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbcaf8c-2d25-4ed8-8d5a-035cae5f655d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:25:58.072996 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.auth.core [None req-0fbcaf8c-2d25-4ed8-8d5a-035cae5f655d None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:25:58.075191 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.fernet_utils [None req-0fbcaf8c-2d25-4ed8-8d5a-035cae5f655d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:25:58.154709 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ff7faa-7681-4fc1-9be5-74250f113909 None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:25:58.185743 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:25:58.200808 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 22/39] 10.222.0.104 () {58 vars in 1029 bytes} [Tue Aug 9 16:25:58 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 16:25:58.206203 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cb3223-cc62-4636-9c18-0b371501ac32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:25:58.206867 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cb3223-cc62-4636-9c18-0b371501ac32 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:25:58.207179 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cb3223-cc62-4636-9c18-0b371501ac32 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:25:58.207464 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cb3223-cc62-4636-9c18-0b371501ac32 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:25:58.208717 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cb3223-cc62-4636-9c18-0b371501ac32 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:25:58.210312 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cb3223-cc62-4636-9c18-0b371501ac32 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:25:58.210634 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92f7958-f057-4270-8fdc-c592e21c1895 None None] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:25:58.210998 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92f7958-f057-4270-8fdc-c592e21c1895 None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:25:58.211257 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92f7958-f057-4270-8fdc-c592e21c1895 None None] PATH_INFO: `/` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:25:58.211975 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 18/40] 10.222.0.104 () {56 vars in 1113 bytes} [Tue Aug 9 16:25:57 2022] GET /identity/v3/domains/default => generated 200 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:25:58.212708 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 23/41] 10.222.0.104 () {54 vars in 932 bytes} [Tue Aug 9 16:25:58 2022] GET /identity => generated 271 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:25:58.219571 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cb3223-cc62-4636-9c18-0b371501ac32 None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:25:58.231527 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92f7958-f057-4270-8fdc-c592e21c1895 None None] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:25:58.315150 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:25:58.352856 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cb3223-cc62-4636-9c18-0b371501ac32 None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:25:58.369413 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92f7958-f057-4270-8fdc-c592e21c1895 None None] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:25:58.386923 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bf7a9a-b299-426a-9267-ff40008baac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:25:58.387686 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bf7a9a-b299-426a-9267-ff40008baac5 None admin] REQUEST_METHOD: `PUT` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:25:58.387965 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bf7a9a-b299-426a-9267-ff40008baac5 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:25:58.388246 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bf7a9a-b299-426a-9267-ff40008baac5 None admin] PATH_INFO: `/v3/domains/default/users/cd0c59114b4e47af86cbee7e2a704cf6/roles/c0143e35c1344a39a931bbb6bcd5acdc` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:25:58.390490 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bf7a9a-b299-426a-9267-ff40008baac5 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=cd0c59114b4e47af86cbee7e2a704cf6, role_id=c0143e35c1344a39a931bbb6bcd5acdc)` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:25:58.392101 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bf7a9a-b299-426a-9267-ff40008baac5 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:25:58.406011 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e6e42b-edb8-45d9-b5df-f41a6693dcdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:25:58.406726 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e6e42b-edb8-45d9-b5df-f41a6693dcdd None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:25:58.407015 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e6e42b-edb8-45d9-b5df-f41a6693dcdd None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:25:58.407292 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e6e42b-edb8-45d9-b5df-f41a6693dcdd None admin] PATH_INFO: `/v3/domains/default` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:25:58.407547 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 19/42] 10.222.0.104 () {58 vars in 1366 bytes} [Tue Aug 9 16:25:58 2022] PUT /identity/v3/domains/default/users/cd0c59114b4e47af86cbee7e2a704cf6/roles/c0143e35c1344a39a931bbb6bcd5acdc => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 16:25:58.408624 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e6e42b-edb8-45d9-b5df-f41a6693dcdd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:25:58.408743 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc3f0a1-6a91-401b-9f0e-3ccc2c07e66b None None] REQUEST_METHOD: `POST` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:25:58.409036 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc3f0a1-6a91-401b-9f0e-3ccc2c07e66b None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:25:58.409298 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc3f0a1-6a91-401b-9f0e-3ccc2c07e66b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:25:58.410127 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e6e42b-edb8-45d9-b5df-f41a6693dcdd None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:25:58.412561 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 24/43] 10.222.0.104 () {56 vars in 1113 bytes} [Tue Aug 9 16:25:58 2022] GET /identity/v3/domains/default => generated 200 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:25:58.418410 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e6e42b-edb8-45d9-b5df-f41a6693dcdd None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:25:58.433286 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.auth.core [None req-bcc3f0a1-6a91-401b-9f0e-3ccc2c07e66b None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:25:58.434713 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.fernet_utils [None req-bcc3f0a1-6a91-401b-9f0e-3ccc2c07e66b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:25:58.492357 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:25:58.516810 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 20/44] 10.222.0.104 () {58 vars in 1029 bytes} [Tue Aug 9 16:25:58 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 16:25:58.541082 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc3f0a1-6a91-401b-9f0e-3ccc2c07e66b None None] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:25:58.548134 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e6e42b-edb8-45d9-b5df-f41a6693dcdd None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:25:58.577778 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:25:58.589241 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324191af-a47b-4da1-ac5e-c63d6513399f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:25:58.589872 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324191af-a47b-4da1-ac5e-c63d6513399f None admin] REQUEST_METHOD: `POST` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:25:58.590580 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324191af-a47b-4da1-ac5e-c63d6513399f None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:25:58.590580 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324191af-a47b-4da1-ac5e-c63d6513399f None admin] PATH_INFO: `/v3/projects` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:25:58.591078 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324191af-a47b-4da1-ac5e-c63d6513399f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:25:58.592901 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324191af-a47b-4da1-ac5e-c63d6513399f None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:25:58.630062 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 25/45] 10.222.0.104 () {60 vars in 1146 bytes} [Tue Aug 9 16:25:58 2022] POST /identity/v3/projects => generated 313 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 16:25:58.660594 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc3f0a1-6a91-401b-9f0e-3ccc2c07e66b None None] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:25:58.699187 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697f89bf-0ff0-4d42-8386-9a1431e30810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:25:58.699829 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697f89bf-0ff0-4d42-8386-9a1431e30810 None admin] REQUEST_METHOD: `POST` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:25:58.700106 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697f89bf-0ff0-4d42-8386-9a1431e30810 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:25:58.700378 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697f89bf-0ff0-4d42-8386-9a1431e30810 None admin] PATH_INFO: `/v3/roles` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:25:58.701055 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697f89bf-0ff0-4d42-8386-9a1431e30810 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:25:58.702557 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697f89bf-0ff0-4d42-8386-9a1431e30810 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:25:58.721994 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 21/46] 10.222.0.104 () {60 vars in 1136 bytes} [Tue Aug 9 16:25:58 2022] POST /identity/v3/roles => generated 224 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 16:26:00.719886 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebb3d9c-3976-4ea6-ad5d-019b3a87769d None None] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:00.720451 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebb3d9c-3976-4ea6-ad5d-019b3a87769d None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:00.720451 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebb3d9c-3976-4ea6-ad5d-019b3a87769d None None] PATH_INFO: `/` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:00.721757 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 26/47] 10.222.0.104 () {54 vars in 932 bytes} [Tue Aug 9 16:26:00 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:26:00.727041 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcc26a8-8405-419b-ae55-6a2b93946672 None None] REQUEST_METHOD: `POST` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:00.727431 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcc26a8-8405-419b-ae55-6a2b93946672 None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:00.727603 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcc26a8-8405-419b-ae55-6a2b93946672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:00.747011 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.auth.core [None req-9dcc26a8-8405-419b-ae55-6a2b93946672 None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:26:00.748274 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.fernet_utils [None req-9dcc26a8-8405-419b-ae55-6a2b93946672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:26:00.787465 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:00.820069 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 22/48] 10.222.0.104 () {58 vars in 1029 bytes} [Tue Aug 9 16:26:00 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 16:26:00.843660 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebb3d9c-3976-4ea6-ad5d-019b3a87769d None None] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:00.945304 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebb3d9c-3976-4ea6-ad5d-019b3a87769d None None] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:00.965588 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc25e17e-d456-405d-a6d8-afc61389f28d None None] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:00.965933 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc25e17e-d456-405d-a6d8-afc61389f28d None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:00.966222 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc25e17e-d456-405d-a6d8-afc61389f28d None None] PATH_INFO: `/` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:00.967560 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 23/49] 10.222.0.104 () {54 vars in 932 bytes} [Tue Aug 9 16:26:00 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 09 16:26:00.972630 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f9ad3c-e02e-4c9b-908d-d96a5104a722 None None] REQUEST_METHOD: `POST` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:00.972803 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f9ad3c-e02e-4c9b-908d-d96a5104a722 None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:00.973084 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f9ad3c-e02e-4c9b-908d-d96a5104a722 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:00.980040 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59630573-1c22-4610-838a-266f5f920218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:00.980679 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59630573-1c22-4610-838a-266f5f920218 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:00.980960 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59630573-1c22-4610-838a-266f5f920218 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:00.981232 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59630573-1c22-4610-838a-266f5f920218 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:00.991360 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.auth.core [None req-77f9ad3c-e02e-4c9b-908d-d96a5104a722 None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:26:00.991942 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59630573-1c22-4610-838a-266f5f920218 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 16:26:00.992571 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.fernet_utils [None req-77f9ad3c-e02e-4c9b-908d-d96a5104a722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:26:00.996708 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application [None req-59630573-1c22-4610-838a-266f5f920218 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 16:26:00.996708 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:26:00.996708 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:26:00.996708 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:26:00.996708 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:26:00.996708 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:26:00.996708 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:26:00.996708 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:26:00.996708 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:26:00.996708 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:26:00.996708 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:26:00.996708 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:26:00.996708 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 16:26:00.996708 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 16:26:00.996708 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 16:26:00.996708 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 16:26:00.997529 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 16:26:00.997529 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 16:26:00.997529 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 16:26:00.997529 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 16:26:00.997529 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:26:00.997529 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:26:00.997529 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:26:00.997529 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:26:00.997529 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:26:00.997529 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:26:00.997529 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:26:00.997529 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application with Lock( Aug 09 16:26:00.997529 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:26:00.997529 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:26:00.997529 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:26:00.997529 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:26:00.998329 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:26:00.998329 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:26:00.998329 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:26:00.998329 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:26:00.998329 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 16:26:00.998329 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 16:26:00.998329 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 16:26:00.998329 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 16:26:00.998329 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 16:26:00.998329 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 16:26:00.998329 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 16:26:00.998329 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Aug 09 16:26:01.002630 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 27/50] 10.222.0.104 () {56 vars in 1101 bytes} [Tue Aug 9 16:26:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 16:26:01.003506 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59630573-1c22-4610-838a-266f5f920218 None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:01.045663 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:01.068040 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 24/51] 10.222.0.104 () {58 vars in 1029 bytes} [Tue Aug 9 16:26:00 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 16:26:01.091758 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f9ad3c-e02e-4c9b-908d-d96a5104a722 None None] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:01.104212 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59630573-1c22-4610-838a-266f5f920218 None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:01.138994 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ca48d1-0650-4077-a9b0-faa8c6c51ba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:01.139602 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ca48d1-0650-4077-a9b0-faa8c6c51ba7 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:01.139885 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ca48d1-0650-4077-a9b0-faa8c6c51ba7 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:01.140161 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ca48d1-0650-4077-a9b0-faa8c6c51ba7 None admin] PATH_INFO: `/v3/roles` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:01.140818 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ca48d1-0650-4077-a9b0-faa8c6c51ba7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:26:01.141122 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ca48d1-0650-4077-a9b0-faa8c6c51ba7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:01.142549 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ca48d1-0650-4077-a9b0-faa8c6c51ba7 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:01.150486 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 28/52] 10.222.0.104 () {56 vars in 1104 bytes} [Tue Aug 9 16:26:01 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 16:26:01.155961 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ca48d1-0650-4077-a9b0-faa8c6c51ba7 None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:01.188123 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f9ad3c-e02e-4c9b-908d-d96a5104a722 None None] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:01.189628 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:01.224408 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52aa55b-4230-4804-bd6c-d0cc3686f735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:01.224962 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52aa55b-4230-4804-bd6c-d0cc3686f735 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:01.225247 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52aa55b-4230-4804-bd6c-d0cc3686f735 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:01.225525 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52aa55b-4230-4804-bd6c-d0cc3686f735 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:01.226678 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52aa55b-4230-4804-bd6c-d0cc3686f735 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:01.228128 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52aa55b-4230-4804-bd6c-d0cc3686f735 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:01.229696 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 25/53] 10.222.0.104 () {56 vars in 1113 bytes} [Tue Aug 9 16:26:01 2022] GET /identity/v3/domains/default => generated 200 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 16:26:01.235276 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52aa55b-4230-4804-bd6c-d0cc3686f735 None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:01.255258 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ca48d1-0650-4077-a9b0-faa8c6c51ba7 None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:01.256760 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:01.291305 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409e1793-6b9e-48dc-8021-960d98b2f43a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:01.291936 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409e1793-6b9e-48dc-8021-960d98b2f43a None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:01.292229 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409e1793-6b9e-48dc-8021-960d98b2f43a None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:01.292496 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409e1793-6b9e-48dc-8021-960d98b2f43a None admin] PATH_INFO: `/v3/users/cd0c59114b4e47af86cbee7e2a704cf6` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:01.293633 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409e1793-6b9e-48dc-8021-960d98b2f43a None admin] RBAC: Authorizing `identity:get_user(user_id=cd0c59114b4e47af86cbee7e2a704cf6)` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:01.295133 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409e1793-6b9e-48dc-8021-960d98b2f43a None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:01.296871 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 29/54] 10.222.0.104 () {56 vars in 1182 bytes} [Tue Aug 9 16:26:01 2022] GET /identity/v3/users/cd0c59114b4e47af86cbee7e2a704cf6 => generated 248 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 16:26:01.302825 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409e1793-6b9e-48dc-8021-960d98b2f43a None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:01.336264 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52aa55b-4230-4804-bd6c-d0cc3686f735 None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:01.369852 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf8e73d-d143-4c2e-bc28-a9568bd0acb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:01.370492 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf8e73d-d143-4c2e-bc28-a9568bd0acb6 None admin] REQUEST_METHOD: `POST` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:01.370775 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf8e73d-d143-4c2e-bc28-a9568bd0acb6 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:01.371053 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf8e73d-d143-4c2e-bc28-a9568bd0acb6 None admin] PATH_INFO: `/v3/projects` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:01.371690 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf8e73d-d143-4c2e-bc28-a9568bd0acb6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:01.373130 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf8e73d-d143-4c2e-bc28-a9568bd0acb6 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:01.398673 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 26/55] 10.222.0.104 () {60 vars in 1145 bytes} [Tue Aug 9 16:26:01 2022] POST /identity/v3/projects => generated 299 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 16:26:01.401575 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409e1793-6b9e-48dc-8021-960d98b2f43a None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:01.439347 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491fd2a4-b091-4897-b3fc-ecdd39e5356c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:01.439999 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491fd2a4-b091-4897-b3fc-ecdd39e5356c None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:01.440278 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491fd2a4-b091-4897-b3fc-ecdd39e5356c None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:01.440550 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491fd2a4-b091-4897-b3fc-ecdd39e5356c None admin] PATH_INFO: `/v3/domains/default` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:01.441864 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491fd2a4-b091-4897-b3fc-ecdd39e5356c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:01.443467 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491fd2a4-b091-4897-b3fc-ecdd39e5356c None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:01.445286 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 30/56] 10.222.0.104 () {56 vars in 1113 bytes} [Tue Aug 9 16:26:01 2022] GET /identity/v3/domains/default => generated 200 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 16:26:01.451137 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf8e73d-d143-4c2e-bc28-a9568bd0acb6 None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:01.478607 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:01.558592 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf8e73d-d143-4c2e-bc28-a9568bd0acb6 None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:01.593662 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45656955-74a5-42ec-989d-520996d06d25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:01.594327 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45656955-74a5-42ec-989d-520996d06d25 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:01.594609 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45656955-74a5-42ec-989d-520996d06d25 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:01.594889 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45656955-74a5-42ec-989d-520996d06d25 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:01.595613 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45656955-74a5-42ec-989d-520996d06d25 None admin] RBAC: Adding query filter params (role.id=c0143e35c1344a39a931bbb6bcd5acdc, scope.domain.id=default, user.id=cd0c59114b4e47af86cbee7e2a704cf6) {{(pid=87276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:26:01.595923 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45656955-74a5-42ec-989d-520996d06d25 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:01.597354 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45656955-74a5-42ec-989d-520996d06d25 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:01.605919 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 27/57] 10.222.0.104 () {56 vars in 1327 bytes} [Tue Aug 9 16:26:01 2022] GET /identity/v3/role_assignments?user.id=cd0c59114b4e47af86cbee7e2a704cf6&scope.domain.id=default&role.id=c0143e35c1344a39a931bbb6bcd5acdc => generated 532 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 16:26:03.700067 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82161ed1-a16d-418b-91c0-6dd00e3901d9 None None] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:03.700619 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82161ed1-a16d-418b-91c0-6dd00e3901d9 None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:03.700619 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82161ed1-a16d-418b-91c0-6dd00e3901d9 None None] PATH_INFO: `/` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:03.701963 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 31/58] 10.222.0.104 () {54 vars in 932 bytes} [Tue Aug 9 16:26:03 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:26:03.707286 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11ced55-4ba3-4f19-b668-872ff5386791 None None] REQUEST_METHOD: `POST` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:03.707704 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11ced55-4ba3-4f19-b668-872ff5386791 None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:03.707835 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11ced55-4ba3-4f19-b668-872ff5386791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:03.726550 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.auth.core [None req-f11ced55-4ba3-4f19-b668-872ff5386791 None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:26:03.727721 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.fernet_utils [None req-f11ced55-4ba3-4f19-b668-872ff5386791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:26:03.792510 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 28/59] 10.222.0.104 () {58 vars in 1029 bytes} [Tue Aug 9 16:26:03 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 16:26:03.817922 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82161ed1-a16d-418b-91c0-6dd00e3901d9 None None] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:03.857666 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:03.916461 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82161ed1-a16d-418b-91c0-6dd00e3901d9 None None] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:03.949178 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87ed8b6-4741-4991-9732-e1a501304ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:03.949797 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87ed8b6-4741-4991-9732-e1a501304ba2 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:03.950160 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87ed8b6-4741-4991-9732-e1a501304ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:03.950393 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87ed8b6-4741-4991-9732-e1a501304ba2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:03.951506 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87ed8b6-4741-4991-9732-e1a501304ba2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:03.952948 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87ed8b6-4741-4991-9732-e1a501304ba2 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:03.954519 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 32/60] 10.222.0.104 () {56 vars in 1113 bytes} [Tue Aug 9 16:26:03 2022] GET /identity/v3/domains/default => generated 200 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:26:03.960489 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11ced55-4ba3-4f19-b668-872ff5386791 None None] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:03.977835 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:04.055809 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11ced55-4ba3-4f19-b668-872ff5386791 None None] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:04.088248 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027359f4-142d-4d6a-82cf-bb05ee734d7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:04.088845 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027359f4-142d-4d6a-82cf-bb05ee734d7f None admin] REQUEST_METHOD: `POST` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:04.089122 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027359f4-142d-4d6a-82cf-bb05ee734d7f None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:04.089392 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027359f4-142d-4d6a-82cf-bb05ee734d7f None admin] PATH_INFO: `/v3/users` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:04.090051 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027359f4-142d-4d6a-82cf-bb05ee734d7f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:04.091492 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027359f4-142d-4d6a-82cf-bb05ee734d7f None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:04.117274 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 29/61] 10.222.0.104 () {60 vars in 1137 bytes} [Tue Aug 9 16:26:03 2022] POST /identity/v3/users => generated 276 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 16:26:07.747323 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66b9fee-0e2a-46a4-9c95-c7f26d33cbe3 None None] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:07.747836 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66b9fee-0e2a-46a4-9c95-c7f26d33cbe3 None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:07.747908 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66b9fee-0e2a-46a4-9c95-c7f26d33cbe3 None None] PATH_INFO: `/` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:07.749198 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 33/62] 10.222.0.104 () {54 vars in 932 bytes} [Tue Aug 9 16:26:07 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:26:07.755056 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62cd62e-9e82-49ea-9a85-17e2cc2769e9 None None] REQUEST_METHOD: `POST` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:07.755954 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62cd62e-9e82-49ea-9a85-17e2cc2769e9 None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:07.756414 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62cd62e-9e82-49ea-9a85-17e2cc2769e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:07.790370 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.auth.core [None req-b62cd62e-9e82-49ea-9a85-17e2cc2769e9 None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:26:07.792433 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.fernet_utils [None req-b62cd62e-9e82-49ea-9a85-17e2cc2769e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:26:07.843998 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4369cf1-74ac-4816-857b-7306449a4342 None None] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:07.844630 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4369cf1-74ac-4816-857b-7306449a4342 None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:07.845261 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4369cf1-74ac-4816-857b-7306449a4342 None None] PATH_INFO: `/` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:07.846883 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 34/63] 10.222.0.104 () {54 vars in 932 bytes} [Tue Aug 9 16:26:07 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 09 16:26:07.853882 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af2e696-6917-4c52-9e30-9e67bd61f57d None None] REQUEST_METHOD: `POST` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:07.854430 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af2e696-6917-4c52-9e30-9e67bd61f57d None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:07.854943 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af2e696-6917-4c52-9e30-9e67bd61f57d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:07.887738 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.auth.core [None req-5af2e696-6917-4c52-9e30-9e67bd61f57d None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:26:07.889170 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.fernet_utils [None req-5af2e696-6917-4c52-9e30-9e67bd61f57d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:26:07.892209 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 30/64] 10.222.0.104 () {58 vars in 1029 bytes} [Tue Aug 9 16:26:07 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 16:26:07.938597 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62cd62e-9e82-49ea-9a85-17e2cc2769e9 None None] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:07.942007 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:08.007928 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 35/65] 10.222.0.104 () {58 vars in 1029 bytes} [Tue Aug 9 16:26:07 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 16:26:08.009199 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7062c76b-d867-4d14-9669-9cb905dbcecf None None] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:08.009483 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7062c76b-d867-4d14-9669-9cb905dbcecf None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:08.009758 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7062c76b-d867-4d14-9669-9cb905dbcecf None None] PATH_INFO: `/` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:08.017842 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 36/66] 10.222.0.104 () {54 vars in 932 bytes} [Tue Aug 9 16:26:08 2022] GET /identity => generated 271 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:26:08.024168 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44fff54-2fb1-4d41-a424-26377e3f286e None None] REQUEST_METHOD: `POST` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:08.024634 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44fff54-2fb1-4d41-a424-26377e3f286e None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:08.025150 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44fff54-2fb1-4d41-a424-26377e3f286e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:08.045177 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.auth.core [None req-e44fff54-2fb1-4d41-a424-26377e3f286e None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:26:08.046411 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.fernet_utils [None req-e44fff54-2fb1-4d41-a424-26377e3f286e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:26:08.072232 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62cd62e-9e82-49ea-9a85-17e2cc2769e9 None None] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:08.076424 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:08.115231 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2689df47-e67c-4794-b809-19e7ee92efe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:08.115962 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2689df47-e67c-4794-b809-19e7ee92efe5 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:08.116334 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2689df47-e67c-4794-b809-19e7ee92efe5 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:08.116677 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2689df47-e67c-4794-b809-19e7ee92efe5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:08.118999 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 37/67] 10.222.0.104 () {58 vars in 1029 bytes} [Tue Aug 9 16:26:08 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 16:26:08.127284 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2689df47-e67c-4794-b809-19e7ee92efe5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 16:26:08.131255 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9489d345-d176-4b21-8f17-5586443f1699 None None] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:08.131545 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9489d345-d176-4b21-8f17-5586443f1699 None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:08.131820 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9489d345-d176-4b21-8f17-5586443f1699 None None] PATH_INFO: `/` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:08.132608 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application [None req-2689df47-e67c-4794-b809-19e7ee92efe5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 09 16:26:08.132608 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:26:08.132608 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:26:08.132608 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:26:08.132608 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:26:08.132608 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:26:08.132608 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:26:08.132608 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:26:08.132608 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:26:08.132608 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:26:08.132608 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:26:08.132608 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:26:08.132608 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 16:26:08.132608 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 16:26:08.132608 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 16:26:08.132608 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 16:26:08.133439 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 16:26:08.133439 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 16:26:08.133439 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 16:26:08.133439 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 16:26:08.133439 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:26:08.133439 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:26:08.133439 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:26:08.133439 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:26:08.133439 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:26:08.133439 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:26:08.133439 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:26:08.133439 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application with Lock( Aug 09 16:26:08.133439 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:26:08.133439 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:26:08.133439 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:26:08.133439 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:26:08.134583 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:26:08.134583 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:26:08.134583 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:26:08.134583 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:26:08.134583 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 16:26:08.134583 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 16:26:08.134583 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 16:26:08.134583 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 16:26:08.134583 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 16:26:08.134583 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 16:26:08.134583 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 09 16:26:08.134583 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Aug 09 16:26:08.135161 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 38/68] 10.222.0.104 () {54 vars in 932 bytes} [Tue Aug 9 16:26:08 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:26:08.135161 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9489d345-d176-4b21-8f17-5586443f1699 None None] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:08.142121 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 31/69] 10.222.0.104 () {56 vars in 1104 bytes} [Tue Aug 9 16:26:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 16:26:08.142121 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7918fba2-3792-41a7-83ce-7cd3f07c9e52 None None] REQUEST_METHOD: `POST` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:08.142121 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7918fba2-3792-41a7-83ce-7cd3f07c9e52 None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:08.142121 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7918fba2-3792-41a7-83ce-7cd3f07c9e52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:08.160482 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.auth.core [None req-7918fba2-3792-41a7-83ce-7cd3f07c9e52 None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:26:08.162376 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.fernet_utils [None req-7918fba2-3792-41a7-83ce-7cd3f07c9e52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:26:08.228276 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:08.239501 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 32/70] 10.222.0.104 () {58 vars in 1029 bytes} [Tue Aug 9 16:26:08 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 16:26:08.240324 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7918fba2-3792-41a7-83ce-7cd3f07c9e52 None None] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:08.257276 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9489d345-d176-4b21-8f17-5586443f1699 None None] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:08.292823 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026b0c4a-d598-4948-8829-7176c5a6b4f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:08.293382 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026b0c4a-d598-4948-8829-7176c5a6b4f3 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:08.293660 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026b0c4a-d598-4948-8829-7176c5a6b4f3 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:08.293957 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026b0c4a-d598-4948-8829-7176c5a6b4f3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:08.304133 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026b0c4a-d598-4948-8829-7176c5a6b4f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 16:26:08.308846 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application [None req-026b0c4a-d598-4948-8829-7176c5a6b4f3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 16:26:08.308846 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:26:08.308846 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:26:08.308846 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:26:08.308846 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:26:08.308846 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:26:08.308846 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:26:08.308846 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:26:08.308846 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:26:08.308846 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:26:08.308846 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:26:08.308846 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:26:08.308846 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 16:26:08.308846 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 16:26:08.308846 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 16:26:08.308846 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 16:26:08.309877 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 16:26:08.309877 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 16:26:08.309877 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 16:26:08.309877 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 16:26:08.309877 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:26:08.309877 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:26:08.309877 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:26:08.309877 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:26:08.309877 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:26:08.309877 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:26:08.309877 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:26:08.309877 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application with Lock( Aug 09 16:26:08.309877 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:26:08.309877 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:26:08.309877 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:26:08.309877 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:26:08.310686 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:26:08.310686 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:26:08.310686 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:26:08.310686 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:26:08.310686 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 16:26:08.310686 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 16:26:08.310686 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 16:26:08.310686 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 16:26:08.310686 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 16:26:08.310686 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 16:26:08.310686 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 16:26:08.310686 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Aug 09 16:26:08.310686 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 39/71] 10.222.0.104 () {56 vars in 1119 bytes} [Tue Aug 9 16:26:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 16:26:08.315142 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026b0c4a-d598-4948-8829-7176c5a6b4f3 None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:08.341086 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7918fba2-3792-41a7-83ce-7cd3f07c9e52 None None] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:08.344567 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:08.374069 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f595f16-48d6-4b34-8ed5-f938998efbbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:08.374684 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f595f16-48d6-4b34-8ed5-f938998efbbd None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:08.374965 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f595f16-48d6-4b34-8ed5-f938998efbbd None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:08.375249 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f595f16-48d6-4b34-8ed5-f938998efbbd None admin] PATH_INFO: `/v3/roles` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:08.375916 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f595f16-48d6-4b34-8ed5-f938998efbbd None admin] RBAC: Adding query filter params (name=member) {{(pid=87276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:26:08.376222 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f595f16-48d6-4b34-8ed5-f938998efbbd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:08.377608 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f595f16-48d6-4b34-8ed5-f938998efbbd None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:08.386593 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 33/72] 10.222.0.104 () {56 vars in 1106 bytes} [Tue Aug 9 16:26:08 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:26:08.387763 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc74c4d1-c96b-46e9-8bf3-ddc1abdd4479 None None] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:08.388047 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc74c4d1-c96b-46e9-8bf3-ddc1abdd4479 None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:08.388324 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc74c4d1-c96b-46e9-8bf3-ddc1abdd4479 None None] PATH_INFO: `/` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:08.389665 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 34/73] 10.222.0.104 () {54 vars in 932 bytes} [Tue Aug 9 16:26:08 2022] GET /identity => generated 271 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:26:08.390294 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc74c4d1-c96b-46e9-8bf3-ddc1abdd4479 None None] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:08.422402 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026b0c4a-d598-4948-8829-7176c5a6b4f3 None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:08.450546 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:08.458991 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d64cda-9af1-4273-949b-8aa35d7f9e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:08.459626 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d64cda-9af1-4273-949b-8aa35d7f9e68 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:08.459908 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d64cda-9af1-4273-949b-8aa35d7f9e68 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:08.460181 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d64cda-9af1-4273-949b-8aa35d7f9e68 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:08.470274 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d64cda-9af1-4273-949b-8aa35d7f9e68 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 16:26:08.475068 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application [None req-26d64cda-9af1-4273-949b-8aa35d7f9e68 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 16:26:08.475068 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:26:08.475068 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:26:08.475068 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:26:08.475068 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:26:08.475068 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:26:08.475068 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:26:08.475068 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:26:08.475068 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:26:08.475068 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:26:08.475068 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:26:08.475068 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:26:08.475068 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 16:26:08.475068 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 16:26:08.475068 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 16:26:08.475068 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 16:26:08.475980 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 16:26:08.475980 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 16:26:08.475980 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 16:26:08.475980 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 16:26:08.475980 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:26:08.475980 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:26:08.475980 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:26:08.475980 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:26:08.475980 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:26:08.475980 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:26:08.475980 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:26:08.475980 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application with Lock( Aug 09 16:26:08.475980 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:26:08.475980 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:26:08.475980 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:26:08.475980 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:26:08.476730 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:26:08.476730 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:26:08.476730 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:26:08.476730 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:26:08.476730 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 16:26:08.476730 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 16:26:08.476730 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 16:26:08.476730 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 16:26:08.476730 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 16:26:08.476730 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 16:26:08.476730 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 16:26:08.476730 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Aug 09 16:26:08.476730 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 40/74] 10.222.0.104 () {56 vars in 1101 bytes} [Tue Aug 9 16:26:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 16:26:08.477350 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d64cda-9af1-4273-949b-8aa35d7f9e68 None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:08.499610 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc74c4d1-c96b-46e9-8bf3-ddc1abdd4479 None None] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:08.533044 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b5124e-882a-4fac-a4c9-7b00b7db349b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:08.533698 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b5124e-882a-4fac-a4c9-7b00b7db349b None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:08.534005 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b5124e-882a-4fac-a4c9-7b00b7db349b None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:08.534307 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b5124e-882a-4fac-a4c9-7b00b7db349b None admin] PATH_INFO: `/v3/roles/member` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:08.544311 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b5124e-882a-4fac-a4c9-7b00b7db349b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 16:26:08.549180 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application [None req-f0b5124e-882a-4fac-a4c9-7b00b7db349b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 09 16:26:08.549180 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:26:08.549180 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:26:08.549180 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:26:08.549180 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:26:08.549180 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:26:08.549180 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:26:08.549180 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:26:08.549180 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:26:08.549180 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:26:08.549180 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:26:08.549180 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:26:08.549180 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 16:26:08.549180 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 16:26:08.549180 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 16:26:08.549180 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 16:26:08.550827 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 16:26:08.550827 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 16:26:08.550827 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 16:26:08.550827 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 16:26:08.550827 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:26:08.550827 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:26:08.550827 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:26:08.550827 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:26:08.550827 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:26:08.550827 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:26:08.550827 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:26:08.550827 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application with Lock( Aug 09 16:26:08.550827 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:26:08.550827 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:26:08.550827 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:26:08.550827 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:26:08.551586 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:26:08.551586 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:26:08.551586 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:26:08.551586 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:26:08.551586 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 16:26:08.551586 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 16:26:08.551586 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 16:26:08.551586 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 16:26:08.551586 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 16:26:08.551586 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 16:26:08.551586 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 09 16:26:08.551586 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Aug 09 16:26:08.551586 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 35/75] 10.222.0.104 () {56 vars in 1104 bytes} [Tue Aug 9 16:26:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 16:26:08.551586 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b5124e-882a-4fac-a4c9-7b00b7db349b None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:08.567478 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:08.583129 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d64cda-9af1-4273-949b-8aa35d7f9e68 None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:08.616858 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395ee2c3-fc03-495b-b487-e2c922a78762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:08.617468 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395ee2c3-fc03-495b-b487-e2c922a78762 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:08.617750 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395ee2c3-fc03-495b-b487-e2c922a78762 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:08.618065 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395ee2c3-fc03-495b-b487-e2c922a78762 None admin] PATH_INFO: `/v3/roles` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:08.618725 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395ee2c3-fc03-495b-b487-e2c922a78762 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:26:08.619031 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395ee2c3-fc03-495b-b487-e2c922a78762 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:08.620429 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395ee2c3-fc03-495b-b487-e2c922a78762 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:08.629163 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 41/76] 10.222.0.104 () {56 vars in 1116 bytes} [Tue Aug 9 16:26:08 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:26:08.629163 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3995c73-edee-44a2-9fb4-388e3ecdfd86 None None] REQUEST_METHOD: `POST` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:08.629163 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3995c73-edee-44a2-9fb4-388e3ecdfd86 None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:08.629163 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3995c73-edee-44a2-9fb4-388e3ecdfd86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:08.649967 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.auth.core [None req-c3995c73-edee-44a2-9fb4-388e3ecdfd86 None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:26:08.651151 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.fernet_utils [None req-c3995c73-edee-44a2-9fb4-388e3ecdfd86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:26:08.653397 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b5124e-882a-4fac-a4c9-7b00b7db349b None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:08.667925 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:08.688294 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3bcdc0-a7e9-4427-a798-cf9ce13a68bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:08.688924 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3bcdc0-a7e9-4427-a798-cf9ce13a68bd None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:08.689205 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3bcdc0-a7e9-4427-a798-cf9ce13a68bd None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:08.689479 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3bcdc0-a7e9-4427-a798-cf9ce13a68bd None admin] PATH_INFO: `/v3/users/90e486c670fa4bac812f14eb300edcae` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:08.704269 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3bcdc0-a7e9-4427-a798-cf9ce13a68bd None admin] RBAC: Authorizing `identity:get_user(user_id=90e486c670fa4bac812f14eb300edcae)` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:08.705740 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3bcdc0-a7e9-4427-a798-cf9ce13a68bd None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:08.707930 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 36/77] 10.222.0.104 () {56 vars in 1182 bytes} [Tue Aug 9 16:26:08 2022] GET /identity/v3/users/90e486c670fa4bac812f14eb300edcae => generated 276 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:26:08.708692 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3bcdc0-a7e9-4427-a798-cf9ce13a68bd None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:08.733921 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 42/78] 10.222.0.104 () {58 vars in 1029 bytes} [Tue Aug 9 16:26:08 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 16:26:08.733921 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3995c73-edee-44a2-9fb4-388e3ecdfd86 None None] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:08.798244 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:08.815060 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3bcdc0-a7e9-4427-a798-cf9ce13a68bd None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:08.820633 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3995c73-edee-44a2-9fb4-388e3ecdfd86 None None] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:08.848835 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fb2cbe-83db-4ab8-ba2c-197a02ae9233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:08.849444 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fb2cbe-83db-4ab8-ba2c-197a02ae9233 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:08.849726 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fb2cbe-83db-4ab8-ba2c-197a02ae9233 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:08.850041 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fb2cbe-83db-4ab8-ba2c-197a02ae9233 None admin] PATH_INFO: `/v3/roles` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:08.850699 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fb2cbe-83db-4ab8-ba2c-197a02ae9233 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:26:08.851009 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fb2cbe-83db-4ab8-ba2c-197a02ae9233 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:08.852387 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fb2cbe-83db-4ab8-ba2c-197a02ae9233 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:08.854508 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ecd393-f799-4137-a0a9-3f38bd3b8075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:08.855108 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ecd393-f799-4137-a0a9-3f38bd3b8075 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:08.855401 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ecd393-f799-4137-a0a9-3f38bd3b8075 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:08.855656 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ecd393-f799-4137-a0a9-3f38bd3b8075 None admin] PATH_INFO: `/v3/roles` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:08.856304 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ecd393-f799-4137-a0a9-3f38bd3b8075 None admin] RBAC: Adding query filter params (name=member) {{(pid=87275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:26:08.856605 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ecd393-f799-4137-a0a9-3f38bd3b8075 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:08.858028 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ecd393-f799-4137-a0a9-3f38bd3b8075 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:08.860278 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 37/79] 10.222.0.104 () {56 vars in 1104 bytes} [Tue Aug 9 16:26:08 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:26:08.861069 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fb2cbe-83db-4ab8-ba2c-197a02ae9233 None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:08.866034 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 43/80] 10.222.0.104 () {56 vars in 1106 bytes} [Tue Aug 9 16:26:08 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:26:08.870816 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ecd393-f799-4137-a0a9-3f38bd3b8075 None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:08.896669 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:08.962725 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fb2cbe-83db-4ab8-ba2c-197a02ae9233 None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:08.970193 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ecd393-f799-4137-a0a9-3f38bd3b8075 None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:08.996319 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e4a4e9-846b-43b9-bb0c-80e851e02fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:08.996947 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e4a4e9-846b-43b9-bb0c-80e851e02fc5 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:08.997233 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e4a4e9-846b-43b9-bb0c-80e851e02fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:08.997512 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e4a4e9-846b-43b9-bb0c-80e851e02fc5 None admin] PATH_INFO: `/v3/users/90e486c670fa4bac812f14eb300edcae` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:08.998702 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e4a4e9-846b-43b9-bb0c-80e851e02fc5 None admin] RBAC: Authorizing `identity:get_user(user_id=90e486c670fa4bac812f14eb300edcae)` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:09.000160 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e4a4e9-846b-43b9-bb0c-80e851e02fc5 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:09.001735 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 38/81] 10.222.0.104 () {56 vars in 1182 bytes} [Tue Aug 9 16:26:08 2022] GET /identity/v3/users/90e486c670fa4bac812f14eb300edcae => generated 276 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:26:09.002534 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e4a4e9-846b-43b9-bb0c-80e851e02fc5 None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:09.006754 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbade8f-8226-4ba6-bf93-30af6b3c5198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:09.007358 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbade8f-8226-4ba6-bf93-30af6b3c5198 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:09.007639 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbade8f-8226-4ba6-bf93-30af6b3c5198 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:09.007913 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbade8f-8226-4ba6-bf93-30af6b3c5198 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:09.018459 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:09.075619 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbade8f-8226-4ba6-bf93-30af6b3c5198 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:09.076993 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbade8f-8226-4ba6-bf93-30af6b3c5198 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:09.107714 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e4a4e9-846b-43b9-bb0c-80e851e02fc5 None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:09.109330 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:09.142997 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415a5cfb-c846-4c54-a9fb-9de134a12223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:09.143654 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415a5cfb-c846-4c54-a9fb-9de134a12223 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:09.143939 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415a5cfb-c846-4c54-a9fb-9de134a12223 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:09.144218 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415a5cfb-c846-4c54-a9fb-9de134a12223 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:09.145373 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415a5cfb-c846-4c54-a9fb-9de134a12223 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:09.146867 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415a5cfb-c846-4c54-a9fb-9de134a12223 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:09.148440 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 39/82] 10.222.0.104 () {56 vars in 1113 bytes} [Tue Aug 9 16:26:09 2022] GET /identity/v3/domains/default => generated 200 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:26:09.149213 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415a5cfb-c846-4c54-a9fb-9de134a12223 None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:09.179173 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 44/83] 10.222.0.104 () {58 vars in 1287 bytes} [Tue Aug 9 16:26:08 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 16:26:09.179876 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbade8f-8226-4ba6-bf93-30af6b3c5198 None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:09.234077 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:09.253208 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415a5cfb-c846-4c54-a9fb-9de134a12223 None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:09.286725 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8852f1b-e3ec-4d7b-8320-9418af8e590d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:09.287350 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8852f1b-e3ec-4d7b-8320-9418af8e590d None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:09.287629 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8852f1b-e3ec-4d7b-8320-9418af8e590d None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:09.287906 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8852f1b-e3ec-4d7b-8320-9418af8e590d None admin] PATH_INFO: `/v3/users/cd0c59114b4e47af86cbee7e2a704cf6` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:09.289033 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8852f1b-e3ec-4d7b-8320-9418af8e590d None admin] RBAC: Authorizing `identity:get_user(user_id=cd0c59114b4e47af86cbee7e2a704cf6)` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:09.290538 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8852f1b-e3ec-4d7b-8320-9418af8e590d None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:09.291557 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbade8f-8226-4ba6-bf93-30af6b3c5198 None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:09.292091 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 40/84] 10.222.0.104 () {56 vars in 1182 bytes} [Tue Aug 9 16:26:09 2022] GET /identity/v3/users/cd0c59114b4e47af86cbee7e2a704cf6 => generated 248 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:26:09.292944 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8852f1b-e3ec-4d7b-8320-9418af8e590d None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:09.324780 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf4bc71-0890-4317-9cb1-8b0b70ae120c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:09.325404 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf4bc71-0890-4317-9cb1-8b0b70ae120c None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:09.325732 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf4bc71-0890-4317-9cb1-8b0b70ae120c None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:09.325983 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf4bc71-0890-4317-9cb1-8b0b70ae120c None admin] PATH_INFO: `/v3/users/90e486c670fa4bac812f14eb300edcae` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:09.327098 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf4bc71-0890-4317-9cb1-8b0b70ae120c None admin] RBAC: Authorizing `identity:get_user(user_id=90e486c670fa4bac812f14eb300edcae)` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:09.328582 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf4bc71-0890-4317-9cb1-8b0b70ae120c None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:09.330269 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 45/85] 10.222.0.104 () {56 vars in 1182 bytes} [Tue Aug 9 16:26:09 2022] GET /identity/v3/users/90e486c670fa4bac812f14eb300edcae => generated 276 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:26:09.331647 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf4bc71-0890-4317-9cb1-8b0b70ae120c None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:09.335108 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:09.396536 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8852f1b-e3ec-4d7b-8320-9418af8e590d None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:09.429245 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0207d93f-98f3-4e39-a392-80b90d4fc74c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:09.429842 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0207d93f-98f3-4e39-a392-80b90d4fc74c None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:09.430147 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0207d93f-98f3-4e39-a392-80b90d4fc74c None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:09.430419 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0207d93f-98f3-4e39-a392-80b90d4fc74c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:09.430764 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf4bc71-0890-4317-9cb1-8b0b70ae120c None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:09.439717 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:09.464460 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d782b6e-53dc-4591-95f2-b7fa2855e287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:09.465057 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d782b6e-53dc-4591-95f2-b7fa2855e287 None admin] REQUEST_METHOD: `POST` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:09.465332 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d782b6e-53dc-4591-95f2-b7fa2855e287 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:09.465604 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d782b6e-53dc-4591-95f2-b7fa2855e287 None admin] PATH_INFO: `/v3/users` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:09.466265 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d782b6e-53dc-4591-95f2-b7fa2855e287 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:09.467698 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d782b6e-53dc-4591-95f2-b7fa2855e287 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:09.495413 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 46/86] 10.222.0.104 () {60 vars in 1137 bytes} [Tue Aug 9 16:26:09 2022] POST /identity/v3/users => generated 290 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 16:26:09.505842 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d782b6e-53dc-4591-95f2-b7fa2855e287 None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:09.505984 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0207d93f-98f3-4e39-a392-80b90d4fc74c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:09.505984 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0207d93f-98f3-4e39-a392-80b90d4fc74c None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:09.548687 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:09.623609 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 41/87] 10.222.0.104 () {58 vars in 1287 bytes} [Tue Aug 9 16:26:09 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 16:26:09.623802 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d782b6e-53dc-4591-95f2-b7fa2855e287 None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:09.623897 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0207d93f-98f3-4e39-a392-80b90d4fc74c None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:09.664635 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265e0f1a-1e7b-45b8-b886-1f72bfdf78b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:09.665295 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265e0f1a-1e7b-45b8-b886-1f72bfdf78b5 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:09.665572 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265e0f1a-1e7b-45b8-b886-1f72bfdf78b5 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:09.665844 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265e0f1a-1e7b-45b8-b886-1f72bfdf78b5 None admin] PATH_INFO: `/v3/projects/8e08184221014bc3bf771cdbe24c6720` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:09.667073 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265e0f1a-1e7b-45b8-b886-1f72bfdf78b5 None admin] RBAC: Authorizing `identity:get_project(project_id=8e08184221014bc3bf771cdbe24c6720)` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:09.668561 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265e0f1a-1e7b-45b8-b886-1f72bfdf78b5 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:09.675651 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 47/88] 10.222.0.104 () {56 vars in 1191 bytes} [Tue Aug 9 16:26:09 2022] GET /identity/v3/projects/8e08184221014bc3bf771cdbe24c6720 => generated 299 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:26:09.675651 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265e0f1a-1e7b-45b8-b886-1f72bfdf78b5 None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:09.714832 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:09.752401 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0207d93f-98f3-4e39-a392-80b90d4fc74c None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:09.805366 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d7896f-ac7b-42ec-975d-fcbefbbc7aa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:09.806040 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d7896f-ac7b-42ec-975d-fcbefbbc7aa2 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:09.806332 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d7896f-ac7b-42ec-975d-fcbefbbc7aa2 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:09.806604 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d7896f-ac7b-42ec-975d-fcbefbbc7aa2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:09.816369 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265e0f1a-1e7b-45b8-b886-1f72bfdf78b5 None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:09.817320 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:09.881876 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5936b8-7a0c-4d40-8b3a-708ebdbb23e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:09.882851 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5936b8-7a0c-4d40-8b3a-708ebdbb23e9 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:09.883337 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5936b8-7a0c-4d40-8b3a-708ebdbb23e9 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:09.883819 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5936b8-7a0c-4d40-8b3a-708ebdbb23e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:09.895257 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d7896f-ac7b-42ec-975d-fcbefbbc7aa2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:09.897152 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d7896f-ac7b-42ec-975d-fcbefbbc7aa2 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:09.981099 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5936b8-7a0c-4d40-8b3a-708ebdbb23e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:09.983270 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5936b8-7a0c-4d40-8b3a-708ebdbb23e9 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:10.006687 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 42/89] 10.222.0.104 () {58 vars in 1287 bytes} [Tue Aug 9 16:26:09 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 16:26:10.007924 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d7896f-ac7b-42ec-975d-fcbefbbc7aa2 None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:10.027197 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:10.059927 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:10.105487 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 48/90] 10.222.0.104 () {58 vars in 1287 bytes} [Tue Aug 9 16:26:09 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 16:26:10.106812 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5936b8-7a0c-4d40-8b3a-708ebdbb23e9 None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:10.138732 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d7896f-ac7b-42ec-975d-fcbefbbc7aa2 None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:10.185986 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99e29e7-4ddf-4f98-af98-92a54a4ea861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:10.187147 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99e29e7-4ddf-4f98-af98-92a54a4ea861 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:10.187433 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99e29e7-4ddf-4f98-af98-92a54a4ea861 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:10.187710 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99e29e7-4ddf-4f98-af98-92a54a4ea861 None admin] PATH_INFO: `/v3/projects/8e08184221014bc3bf771cdbe24c6720` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:10.189783 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99e29e7-4ddf-4f98-af98-92a54a4ea861 None admin] RBAC: Authorizing `identity:get_project(project_id=8e08184221014bc3bf771cdbe24c6720)` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:10.191658 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99e29e7-4ddf-4f98-af98-92a54a4ea861 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:10.194422 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 43/91] 10.222.0.104 () {56 vars in 1191 bytes} [Tue Aug 9 16:26:10 2022] GET /identity/v3/projects/8e08184221014bc3bf771cdbe24c6720 => generated 299 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:26:10.195007 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99e29e7-4ddf-4f98-af98-92a54a4ea861 None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:10.224871 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5936b8-7a0c-4d40-8b3a-708ebdbb23e9 None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:10.258579 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:10.265273 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346f1585-e9e5-4ed5-bac7-d97f4ab851c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:10.266053 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346f1585-e9e5-4ed5-bac7-d97f4ab851c7 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:10.266432 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346f1585-e9e5-4ed5-bac7-d97f4ab851c7 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:10.266803 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346f1585-e9e5-4ed5-bac7-d97f4ab851c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:10.267633 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346f1585-e9e5-4ed5-bac7-d97f4ab851c7 None admin] RBAC: Adding query filter params (role.id=044ca4f80141492b9c128ada543865e8, scope.project.id=8e08184221014bc3bf771cdbe24c6720, user.id=90e486c670fa4bac812f14eb300edcae) {{(pid=87275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:26:10.268045 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346f1585-e9e5-4ed5-bac7-d97f4ab851c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:10.269803 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346f1585-e9e5-4ed5-bac7-d97f4ab851c7 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:10.281929 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 49/92] 10.222.0.104 () {56 vars in 1379 bytes} [Tue Aug 9 16:26:10 2022] GET /identity/v3/role_assignments?user.id=90e486c670fa4bac812f14eb300edcae&scope.project.id=8e08184221014bc3bf771cdbe24c6720&role.id=044ca4f80141492b9c128ada543865e8 => generated 260 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:26:10.281929 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346f1585-e9e5-4ed5-bac7-d97f4ab851c7 None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:10.378412 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99e29e7-4ddf-4f98-af98-92a54a4ea861 None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:10.395369 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:10.469377 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3051a703-8049-4b1e-904e-d48265cc2053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:10.470114 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3051a703-8049-4b1e-904e-d48265cc2053 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:10.470394 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3051a703-8049-4b1e-904e-d48265cc2053 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:10.470666 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3051a703-8049-4b1e-904e-d48265cc2053 None admin] PATH_INFO: `/v3/projects/8e08184221014bc3bf771cdbe24c6720` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:10.472546 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3051a703-8049-4b1e-904e-d48265cc2053 None admin] RBAC: Authorizing `identity:get_project(project_id=8e08184221014bc3bf771cdbe24c6720)` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:10.474997 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3051a703-8049-4b1e-904e-d48265cc2053 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:10.478544 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 44/93] 10.222.0.104 () {56 vars in 1191 bytes} [Tue Aug 9 16:26:10 2022] GET /identity/v3/projects/8e08184221014bc3bf771cdbe24c6720 => generated 299 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:26:10.479408 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3051a703-8049-4b1e-904e-d48265cc2053 None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:10.484005 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346f1585-e9e5-4ed5-bac7-d97f4ab851c7 None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:10.550741 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c900e0e-efa1-4b05-b212-a11406ccab66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:10.551715 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c900e0e-efa1-4b05-b212-a11406ccab66 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:10.552221 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c900e0e-efa1-4b05-b212-a11406ccab66 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:10.552691 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c900e0e-efa1-4b05-b212-a11406ccab66 None admin] PATH_INFO: `/v3/projects/2966cedde9c44486bcb32a457df8d6c5` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:10.554445 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c900e0e-efa1-4b05-b212-a11406ccab66 None admin] RBAC: Authorizing `identity:get_project(project_id=2966cedde9c44486bcb32a457df8d6c5)` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:10.556123 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c900e0e-efa1-4b05-b212-a11406ccab66 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:10.566470 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 50/94] 10.222.0.104 () {56 vars in 1191 bytes} [Tue Aug 9 16:26:10 2022] GET /identity/v3/projects/2966cedde9c44486bcb32a457df8d6c5 => generated 313 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:26:10.568390 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c900e0e-efa1-4b05-b212-a11406ccab66 None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:10.634977 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3051a703-8049-4b1e-904e-d48265cc2053 None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:10.684937 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:10.702624 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd60a55a-94f0-41ef-8989-76b4fe72d4af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:10.703587 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd60a55a-94f0-41ef-8989-76b4fe72d4af None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:10.704105 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd60a55a-94f0-41ef-8989-76b4fe72d4af None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:10.704599 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd60a55a-94f0-41ef-8989-76b4fe72d4af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:10.705528 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd60a55a-94f0-41ef-8989-76b4fe72d4af None admin] RBAC: Adding query filter params (role.id=8a954d5b81f74df1985780d968ff3073, scope.project.id=8e08184221014bc3bf771cdbe24c6720, user.id=90e486c670fa4bac812f14eb300edcae) {{(pid=87276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:26:10.706596 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd60a55a-94f0-41ef-8989-76b4fe72d4af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:10.708245 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd60a55a-94f0-41ef-8989-76b4fe72d4af None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:10.723883 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 45/95] 10.222.0.104 () {56 vars in 1379 bytes} [Tue Aug 9 16:26:10 2022] GET /identity/v3/role_assignments?user.id=90e486c670fa4bac812f14eb300edcae&scope.project.id=8e08184221014bc3bf771cdbe24c6720&role.id=8a954d5b81f74df1985780d968ff3073 => generated 260 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:26:10.724989 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd60a55a-94f0-41ef-8989-76b4fe72d4af None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:10.730814 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c900e0e-efa1-4b05-b212-a11406ccab66 None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:10.786717 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e4330f-53bf-46dd-88f8-c3c17d02e03f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:10.787333 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e4330f-53bf-46dd-88f8-c3c17d02e03f None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:10.787773 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e4330f-53bf-46dd-88f8-c3c17d02e03f None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:10.788062 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e4330f-53bf-46dd-88f8-c3c17d02e03f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:10.788884 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e4330f-53bf-46dd-88f8-c3c17d02e03f None admin] RBAC: Adding query filter params (role.id=c0143e35c1344a39a931bbb6bcd5acdc, scope.project.id=8e08184221014bc3bf771cdbe24c6720, user.id=cd0c59114b4e47af86cbee7e2a704cf6) {{(pid=87275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:26:10.789256 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e4330f-53bf-46dd-88f8-c3c17d02e03f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:10.791410 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e4330f-53bf-46dd-88f8-c3c17d02e03f None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:10.797630 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 51/96] 10.222.0.104 () {56 vars in 1379 bytes} [Tue Aug 9 16:26:10 2022] GET /identity/v3/role_assignments?user.id=cd0c59114b4e47af86cbee7e2a704cf6&scope.project.id=8e08184221014bc3bf771cdbe24c6720&role.id=c0143e35c1344a39a931bbb6bcd5acdc => generated 260 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:26:10.830334 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:10.897452 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd60a55a-94f0-41ef-8989-76b4fe72d4af None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:10.937308 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6985b96a-c951-4924-b76b-fbafd69ac48b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:10.937847 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6985b96a-c951-4924-b76b-fbafd69ac48b None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:10.938213 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6985b96a-c951-4924-b76b-fbafd69ac48b None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:10.938496 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6985b96a-c951-4924-b76b-fbafd69ac48b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:10.939243 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6985b96a-c951-4924-b76b-fbafd69ac48b None admin] RBAC: Adding query filter params (role.id=044ca4f80141492b9c128ada543865e8, scope.project.id=2966cedde9c44486bcb32a457df8d6c5, user.id=90e486c670fa4bac812f14eb300edcae) {{(pid=87276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:26:10.939553 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6985b96a-c951-4924-b76b-fbafd69ac48b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:10.941309 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6985b96a-c951-4924-b76b-fbafd69ac48b None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:10.947952 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 46/97] 10.222.0.104 () {56 vars in 1379 bytes} [Tue Aug 9 16:26:10 2022] GET /identity/v3/role_assignments?user.id=90e486c670fa4bac812f14eb300edcae&scope.project.id=2966cedde9c44486bcb32a457df8d6c5&role.id=044ca4f80141492b9c128ada543865e8 => generated 260 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:26:12.325752 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ac6a19-81c0-4927-b26a-09d3a387ea96 None None] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:12.326379 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ac6a19-81c0-4927-b26a-09d3a387ea96 None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:12.326379 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ac6a19-81c0-4927-b26a-09d3a387ea96 None None] PATH_INFO: `/` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:12.327833 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 52/98] 10.222.0.104 () {54 vars in 932 bytes} [Tue Aug 9 16:26:12 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:26:12.333871 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca36bd2e-dc03-4404-b43a-e325120050ee None None] REQUEST_METHOD: `POST` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:12.334776 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca36bd2e-dc03-4404-b43a-e325120050ee None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:12.335260 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca36bd2e-dc03-4404-b43a-e325120050ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:12.363352 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.auth.core [None req-ca36bd2e-dc03-4404-b43a-e325120050ee None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:26:12.364574 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.fernet_utils [None req-ca36bd2e-dc03-4404-b43a-e325120050ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:26:12.451925 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 47/99] 10.222.0.104 () {58 vars in 1029 bytes} [Tue Aug 9 16:26:12 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 16:26:12.494062 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ac6a19-81c0-4927-b26a-09d3a387ea96 None None] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:12.637856 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ac6a19-81c0-4927-b26a-09d3a387ea96 None None] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:12.672404 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:12.682557 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e766e07-1574-4bef-8727-77d2a0c447d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:12.683479 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e766e07-1574-4bef-8727-77d2a0c447d9 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:12.683970 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e766e07-1574-4bef-8727-77d2a0c447d9 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:12.684495 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e766e07-1574-4bef-8727-77d2a0c447d9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:12.695392 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e766e07-1574-4bef-8727-77d2a0c447d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 16:26:12.701016 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application [None req-1e766e07-1574-4bef-8727-77d2a0c447d9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 09 16:26:12.701016 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:26:12.701016 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:26:12.701016 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:26:12.701016 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:26:12.701016 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:26:12.701016 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:26:12.701016 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:26:12.701016 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:26:12.701016 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:26:12.701016 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:26:12.701016 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:26:12.701016 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 16:26:12.701016 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 16:26:12.701016 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 16:26:12.701016 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 16:26:12.701883 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 16:26:12.701883 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 16:26:12.701883 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 16:26:12.701883 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 16:26:12.701883 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:26:12.701883 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:26:12.701883 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:26:12.701883 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:26:12.701883 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:26:12.701883 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:26:12.701883 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:26:12.701883 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application with Lock( Aug 09 16:26:12.701883 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:26:12.701883 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:26:12.701883 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:26:12.701883 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:26:12.702700 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:26:12.702700 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:26:12.702700 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:26:12.702700 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:26:12.702700 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 16:26:12.702700 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 16:26:12.702700 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 16:26:12.702700 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 16:26:12.702700 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 16:26:12.702700 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 16:26:12.702700 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 09 16:26:12.702700 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Aug 09 16:26:12.705023 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 53/100] 10.222.0.104 () {56 vars in 1104 bytes} [Tue Aug 9 16:26:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 16:26:12.715002 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca36bd2e-dc03-4404-b43a-e325120050ee None None] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:12.747880 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:12.780742 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8074626-f232-4fba-957b-b49c57bce7d7 None None] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:12.781038 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8074626-f232-4fba-957b-b49c57bce7d7 None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:12.781287 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8074626-f232-4fba-957b-b49c57bce7d7 None None] PATH_INFO: `/` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:12.782887 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 54/101] 10.222.0.104 () {54 vars in 932 bytes} [Tue Aug 9 16:26:12 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 09 16:26:12.792914 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6a74c6-4186-477f-b5c4-f446e9084bfd None None] REQUEST_METHOD: `POST` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:12.793194 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6a74c6-4186-477f-b5c4-f446e9084bfd None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:12.793462 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6a74c6-4186-477f-b5c4-f446e9084bfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:12.831118 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.auth.core [None req-2f6a74c6-4186-477f-b5c4-f446e9084bfd None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:26:12.832641 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.fernet_utils [None req-2f6a74c6-4186-477f-b5c4-f446e9084bfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:26:12.890480 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca36bd2e-dc03-4404-b43a-e325120050ee None None] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:12.958059 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8d2e16-1561-4970-826a-f423f2f0362e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:12.958683 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8d2e16-1561-4970-826a-f423f2f0362e None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:12.958961 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8d2e16-1561-4970-826a-f423f2f0362e None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:12.959981 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8d2e16-1561-4970-826a-f423f2f0362e None admin] PATH_INFO: `/v3/roles` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:12.960878 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8d2e16-1561-4970-826a-f423f2f0362e None admin] RBAC: Adding query filter params (name=reader) {{(pid=87276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:26:12.961181 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8d2e16-1561-4970-826a-f423f2f0362e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:12.964598 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8d2e16-1561-4970-826a-f423f2f0362e None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:12.978874 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 55/102] 10.222.0.104 () {58 vars in 1029 bytes} [Tue Aug 9 16:26:12 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 16:26:12.992374 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 48/103] 10.222.0.104 () {56 vars in 1106 bytes} [Tue Aug 9 16:26:12 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:26:12.998505 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6a74c6-4186-477f-b5c4-f446e9084bfd None None] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:13.029238 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8d2e16-1561-4970-826a-f423f2f0362e None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:13.178600 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6a74c6-4186-477f-b5c4-f446e9084bfd None None] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:13.208226 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:13.210422 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:13.219653 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8d2e16-1561-4970-826a-f423f2f0362e None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:13.258087 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2c65bb-b6fd-4c5c-afd1-876a68c02023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:13.258721 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2c65bb-b6fd-4c5c-afd1-876a68c02023 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:13.258999 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2c65bb-b6fd-4c5c-afd1-876a68c02023 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:13.259270 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2c65bb-b6fd-4c5c-afd1-876a68c02023 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:13.260376 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2c65bb-b6fd-4c5c-afd1-876a68c02023 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:13.261814 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2c65bb-b6fd-4c5c-afd1-876a68c02023 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:13.263732 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 49/104] 10.222.0.104 () {56 vars in 1113 bytes} [Tue Aug 9 16:26:13 2022] GET /identity/v3/domains/default => generated 200 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 16:26:13.264921 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8be1977-45e1-4ba3-90a2-003fbdc7a9fa None None] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:13.265207 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8be1977-45e1-4ba3-90a2-003fbdc7a9fa None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:13.265483 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8be1977-45e1-4ba3-90a2-003fbdc7a9fa None None] PATH_INFO: `/` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:13.266613 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959bd9f9-f53e-45f0-a82a-61e177539291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:13.266749 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 50/105] 10.222.0.104 () {54 vars in 932 bytes} [Tue Aug 9 16:26:13 2022] GET /identity => generated 271 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:26:13.267531 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959bd9f9-f53e-45f0-a82a-61e177539291 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:13.267816 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959bd9f9-f53e-45f0-a82a-61e177539291 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:13.268651 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959bd9f9-f53e-45f0-a82a-61e177539291 None admin] PATH_INFO: `/v3/users/76f408bb21ec48ebba9692c37ae07061` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:13.271304 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8be1977-45e1-4ba3-90a2-003fbdc7a9fa None None] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:13.306565 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959bd9f9-f53e-45f0-a82a-61e177539291 None admin] RBAC: Authorizing `identity:get_user(user_id=76f408bb21ec48ebba9692c37ae07061)` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:13.308036 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959bd9f9-f53e-45f0-a82a-61e177539291 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:13.309712 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 56/106] 10.222.0.104 () {56 vars in 1182 bytes} [Tue Aug 9 16:26:12 2022] GET /identity/v3/users/76f408bb21ec48ebba9692c37ae07061 => generated 290 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:26:13.310909 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ad98f9-09d6-4995-9aeb-5fc30a5eb2c9 None None] REQUEST_METHOD: `POST` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:13.311506 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ad98f9-09d6-4995-9aeb-5fc30a5eb2c9 None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:13.311737 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ad98f9-09d6-4995-9aeb-5fc30a5eb2c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:13.354875 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.auth.core [None req-b8ad98f9-09d6-4995-9aeb-5fc30a5eb2c9 None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:26:13.356078 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.fernet_utils [None req-b8ad98f9-09d6-4995-9aeb-5fc30a5eb2c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:26:13.387310 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8be1977-45e1-4ba3-90a2-003fbdc7a9fa None None] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:13.423864 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd34770-5e10-4ec0-bb84-381d475382f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:13.424506 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd34770-5e10-4ec0-bb84-381d475382f0 None admin] REQUEST_METHOD: `POST` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:13.424786 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd34770-5e10-4ec0-bb84-381d475382f0 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:13.425061 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd34770-5e10-4ec0-bb84-381d475382f0 None admin] PATH_INFO: `/v3/projects` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:13.425797 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd34770-5e10-4ec0-bb84-381d475382f0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:13.427394 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd34770-5e10-4ec0-bb84-381d475382f0 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:13.457842 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 51/107] 10.222.0.104 () {60 vars in 1146 bytes} [Tue Aug 9 16:26:13 2022] POST /identity/v3/projects => generated 303 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 16:26:13.458765 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd34770-5e10-4ec0-bb84-381d475382f0 None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:13.481153 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:13.516137 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 57/108] 10.222.0.104 () {58 vars in 1029 bytes} [Tue Aug 9 16:26:13 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 16:26:13.555884 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ad98f9-09d6-4995-9aeb-5fc30a5eb2c9 None None] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:13.616262 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd34770-5e10-4ec0-bb84-381d475382f0 None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:13.679814 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484d2c18-1e95-40a9-911b-6b9ad4ba767b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:13.680445 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484d2c18-1e95-40a9-911b-6b9ad4ba767b None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:13.680729 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484d2c18-1e95-40a9-911b-6b9ad4ba767b None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:13.681004 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484d2c18-1e95-40a9-911b-6b9ad4ba767b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:13.767827 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ad98f9-09d6-4995-9aeb-5fc30a5eb2c9 None None] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:13.786581 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:13.803141 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484d2c18-1e95-40a9-911b-6b9ad4ba767b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:13.804622 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484d2c18-1e95-40a9-911b-6b9ad4ba767b None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:13.831617 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:13.858678 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960a1881-65a9-4ca7-b201-94b4f6685bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:13.859343 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960a1881-65a9-4ca7-b201-94b4f6685bb2 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:13.859783 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960a1881-65a9-4ca7-b201-94b4f6685bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:13.860182 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960a1881-65a9-4ca7-b201-94b4f6685bb2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:13.875067 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960a1881-65a9-4ca7-b201-94b4f6685bb2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 16:26:13.888940 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application [None req-960a1881-65a9-4ca7-b201-94b4f6685bb2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 09 16:26:13.888940 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:26:13.888940 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:26:13.888940 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:26:13.888940 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:26:13.888940 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:26:13.888940 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:26:13.888940 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:26:13.888940 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:26:13.888940 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:26:13.888940 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:26:13.888940 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:26:13.888940 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 16:26:13.888940 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 16:26:13.888940 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 16:26:13.888940 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 16:26:13.889863 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 16:26:13.889863 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 16:26:13.889863 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 16:26:13.889863 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 16:26:13.889863 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:26:13.889863 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:26:13.889863 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:26:13.889863 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:26:13.889863 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:26:13.889863 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:26:13.889863 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:26:13.889863 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application with Lock( Aug 09 16:26:13.889863 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:26:13.889863 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:26:13.889863 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:26:13.889863 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:26:13.890687 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:26:13.890687 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:26:13.890687 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:26:13.890687 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:26:13.890687 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 16:26:13.890687 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 16:26:13.890687 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 16:26:13.890687 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 16:26:13.890687 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 16:26:13.890687 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 16:26:13.890687 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 09 16:26:13.890687 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Aug 09 16:26:13.894394 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 58/109] 10.222.0.104 () {56 vars in 1104 bytes} [Tue Aug 9 16:26:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 16:26:13.900607 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960a1881-65a9-4ca7-b201-94b4f6685bb2 None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:14.001740 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 52/110] 10.222.0.104 () {58 vars in 1287 bytes} [Tue Aug 9 16:26:13 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 543 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 16:26:14.008306 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484d2c18-1e95-40a9-911b-6b9ad4ba767b None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:14.121992 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484d2c18-1e95-40a9-911b-6b9ad4ba767b None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:14.140270 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:14.166407 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ddcea0-96e2-4a92-a25a-c7d41567b2e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:14.167355 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ddcea0-96e2-4a92-a25a-c7d41567b2e2 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:14.167877 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ddcea0-96e2-4a92-a25a-c7d41567b2e2 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:14.168167 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ddcea0-96e2-4a92-a25a-c7d41567b2e2 None admin] PATH_INFO: `/v3/projects/8e08184221014bc3bf771cdbe24c6720` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:14.169340 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ddcea0-96e2-4a92-a25a-c7d41567b2e2 None admin] RBAC: Authorizing `identity:get_project(project_id=8e08184221014bc3bf771cdbe24c6720)` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:14.171518 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ddcea0-96e2-4a92-a25a-c7d41567b2e2 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:14.173730 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 53/111] 10.222.0.104 () {56 vars in 1191 bytes} [Tue Aug 9 16:26:14 2022] GET /identity/v3/projects/8e08184221014bc3bf771cdbe24c6720 => generated 299 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:26:14.180064 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ddcea0-96e2-4a92-a25a-c7d41567b2e2 None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:14.188211 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960a1881-65a9-4ca7-b201-94b4f6685bb2 None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:14.285378 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a159e06c-3c4d-489c-ba89-e50e13ac8f42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:14.286091 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a159e06c-3c4d-489c-ba89-e50e13ac8f42 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:14.286406 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a159e06c-3c4d-489c-ba89-e50e13ac8f42 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:14.286646 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a159e06c-3c4d-489c-ba89-e50e13ac8f42 None admin] PATH_INFO: `/v3/roles` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:14.287373 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a159e06c-3c4d-489c-ba89-e50e13ac8f42 None admin] RBAC: Adding query filter params (name=member) {{(pid=87275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:26:14.287677 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a159e06c-3c4d-489c-ba89-e50e13ac8f42 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:14.289131 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a159e06c-3c4d-489c-ba89-e50e13ac8f42 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:14.305242 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 59/112] 10.222.0.104 () {56 vars in 1106 bytes} [Tue Aug 9 16:26:13 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 405 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 16:26:14.311538 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a159e06c-3c4d-489c-ba89-e50e13ac8f42 None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:14.333370 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ddcea0-96e2-4a92-a25a-c7d41567b2e2 None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:14.370121 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:14.407451 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9317eaa2-b130-4d9b-8196-eaa451062e91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:14.408094 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9317eaa2-b130-4d9b-8196-eaa451062e91 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:14.408283 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9317eaa2-b130-4d9b-8196-eaa451062e91 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:14.408585 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9317eaa2-b130-4d9b-8196-eaa451062e91 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:14.409350 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9317eaa2-b130-4d9b-8196-eaa451062e91 None admin] RBAC: Adding query filter params (role.id=92a80348b6cb4bb38f2a6a9f5facb705, scope.project.id=8e08184221014bc3bf771cdbe24c6720, user.id=76f408bb21ec48ebba9692c37ae07061) {{(pid=87276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:26:14.409706 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9317eaa2-b130-4d9b-8196-eaa451062e91 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:14.411485 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9317eaa2-b130-4d9b-8196-eaa451062e91 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:14.423034 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 54/113] 10.222.0.104 () {56 vars in 1379 bytes} [Tue Aug 9 16:26:14 2022] GET /identity/v3/role_assignments?user.id=76f408bb21ec48ebba9692c37ae07061&scope.project.id=8e08184221014bc3bf771cdbe24c6720&role.id=92a80348b6cb4bb38f2a6a9f5facb705 => generated 260 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:26:14.424927 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23154d6-c6a5-4c09-9516-1aad41f121be None None] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:14.425212 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23154d6-c6a5-4c09-9516-1aad41f121be None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:14.425488 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23154d6-c6a5-4c09-9516-1aad41f121be None None] PATH_INFO: `/` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:14.427047 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 55/114] 10.222.0.104 () {54 vars in 932 bytes} [Tue Aug 9 16:26:14 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:26:14.436330 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa3a098-d535-4e18-8b97-64be903ffbff None None] REQUEST_METHOD: `POST` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:14.436633 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa3a098-d535-4e18-8b97-64be903ffbff None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:14.436876 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa3a098-d535-4e18-8b97-64be903ffbff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:14.472523 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.auth.core [None req-bfa3a098-d535-4e18-8b97-64be903ffbff None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:26:14.473769 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.fernet_utils [None req-bfa3a098-d535-4e18-8b97-64be903ffbff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:26:14.499354 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a159e06c-3c4d-489c-ba89-e50e13ac8f42 None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:14.564557 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:14.575794 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7721ada1-1d13-478b-951d-9937d69a326b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:14.576832 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7721ada1-1d13-478b-951d-9937d69a326b None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:14.577306 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7721ada1-1d13-478b-951d-9937d69a326b None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:14.577806 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7721ada1-1d13-478b-951d-9937d69a326b None admin] PATH_INFO: `/v3/users/90e486c670fa4bac812f14eb300edcae` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:14.579704 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7721ada1-1d13-478b-951d-9937d69a326b None admin] RBAC: Authorizing `identity:get_user(user_id=90e486c670fa4bac812f14eb300edcae)` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:14.581530 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7721ada1-1d13-478b-951d-9937d69a326b None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:14.583778 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 60/115] 10.222.0.104 () {56 vars in 1182 bytes} [Tue Aug 9 16:26:14 2022] GET /identity/v3/users/90e486c670fa4bac812f14eb300edcae => generated 276 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 16:26:14.590022 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7721ada1-1d13-478b-951d-9937d69a326b None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:14.633152 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 56/116] 10.222.0.104 () {58 vars in 1029 bytes} [Tue Aug 9 16:26:14 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 09 16:26:14.634497 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2f9c1a-91d8-4966-bffc-75a738c05eda None None] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:14.634760 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2f9c1a-91d8-4966-bffc-75a738c05eda None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:14.635042 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2f9c1a-91d8-4966-bffc-75a738c05eda None None] PATH_INFO: `/` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:14.641972 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 57/117] 10.222.0.104 () {54 vars in 932 bytes} [Tue Aug 9 16:26:14 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:26:14.659424 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d40fa8-19fc-49b2-86ae-7dd50e223bfc None None] REQUEST_METHOD: `POST` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:14.659739 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d40fa8-19fc-49b2-86ae-7dd50e223bfc None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:14.659998 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d40fa8-19fc-49b2-86ae-7dd50e223bfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:14.692660 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.auth.core [None req-72d40fa8-19fc-49b2-86ae-7dd50e223bfc None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:26:14.694114 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.fernet_utils [None req-72d40fa8-19fc-49b2-86ae-7dd50e223bfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:26:14.738934 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:14.745644 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7721ada1-1d13-478b-951d-9937d69a326b None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:14.785918 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d6a73a-e55e-48fb-ac04-e9e05fd4003e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:14.786837 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d6a73a-e55e-48fb-ac04-e9e05fd4003e None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:14.787171 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d6a73a-e55e-48fb-ac04-e9e05fd4003e None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:14.787446 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d6a73a-e55e-48fb-ac04-e9e05fd4003e None admin] PATH_INFO: `/v3/projects/8e08184221014bc3bf771cdbe24c6720` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:14.788577 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d6a73a-e55e-48fb-ac04-e9e05fd4003e None admin] RBAC: Authorizing `identity:get_project(project_id=8e08184221014bc3bf771cdbe24c6720)` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:14.789232 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 58/118] 10.222.0.104 () {58 vars in 1029 bytes} [Tue Aug 9 16:26:14 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 16:26:14.790055 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d6a73a-e55e-48fb-ac04-e9e05fd4003e None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:14.791093 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a89c15f-3a80-4a44-ada8-8043a2b24983 None None] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:14.791584 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a89c15f-3a80-4a44-ada8-8043a2b24983 None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:14.792110 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a89c15f-3a80-4a44-ada8-8043a2b24983 None None] PATH_INFO: `/` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:14.793586 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 59/120] 10.222.0.104 () {54 vars in 932 bytes} [Tue Aug 9 16:26:14 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:26:14.794548 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a89c15f-3a80-4a44-ada8-8043a2b24983 None None] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:14.796504 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 61/120] 10.222.0.104 () {56 vars in 1191 bytes} [Tue Aug 9 16:26:14 2022] GET /identity/v3/projects/8e08184221014bc3bf771cdbe24c6720 => generated 299 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:26:14.797332 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d6a73a-e55e-48fb-ac04-e9e05fd4003e None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:14.917797 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d6a73a-e55e-48fb-ac04-e9e05fd4003e None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:14.930918 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a89c15f-3a80-4a44-ada8-8043a2b24983 None None] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:14.940694 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:14.964369 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337bfbb4-9470-4377-9360-ecd14749982a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:14.965306 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337bfbb4-9470-4377-9360-ecd14749982a None admin] REQUEST_METHOD: `PUT` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:14.965584 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337bfbb4-9470-4377-9360-ecd14749982a None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:14.965860 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337bfbb4-9470-4377-9360-ecd14749982a None admin] PATH_INFO: `/v3/projects/8e08184221014bc3bf771cdbe24c6720/users/90e486c670fa4bac812f14eb300edcae/roles/044ca4f80141492b9c128ada543865e8` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:14.968689 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337bfbb4-9470-4377-9360-ecd14749982a None admin] RBAC: Authorizing `identity:create_grant(project_id=8e08184221014bc3bf771cdbe24c6720, user_id=90e486c670fa4bac812f14eb300edcae, role_id=044ca4f80141492b9c128ada543865e8)` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:14.970464 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337bfbb4-9470-4377-9360-ecd14749982a None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:14.973126 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b456fa7-7e21-4cb2-9213-0e08cd53c9d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:14.974077 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b456fa7-7e21-4cb2-9213-0e08cd53c9d3 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:14.974548 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b456fa7-7e21-4cb2-9213-0e08cd53c9d3 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:14.975018 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b456fa7-7e21-4cb2-9213-0e08cd53c9d3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:14.987340 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 62/121] 10.222.0.104 () {58 vars in 1444 bytes} [Tue Aug 9 16:26:14 2022] PUT /identity/v3/projects/8e08184221014bc3bf771cdbe24c6720/users/90e486c670fa4bac812f14eb300edcae/roles/044ca4f80141492b9c128ada543865e8 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 16:26:14.988684 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b456fa7-7e21-4cb2-9213-0e08cd53c9d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 16:26:14.988792 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a8128a-3c84-40ca-aa87-022dbadd9be8 None None] REQUEST_METHOD: `POST` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:14.988996 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a8128a-3c84-40ca-aa87-022dbadd9be8 None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:14.989319 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a8128a-3c84-40ca-aa87-022dbadd9be8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:14.994723 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application [None req-0b456fa7-7e21-4cb2-9213-0e08cd53c9d3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 16:26:14.994723 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:26:14.994723 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:26:14.994723 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:26:14.994723 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:26:14.994723 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:26:14.994723 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:26:14.994723 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:26:14.994723 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:26:14.994723 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:26:14.994723 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:26:14.994723 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:26:14.994723 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 16:26:14.994723 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 16:26:14.994723 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 16:26:14.994723 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 16:26:14.995660 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 16:26:14.995660 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 16:26:14.995660 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 16:26:14.995660 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 16:26:14.995660 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:26:14.995660 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:26:14.995660 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:26:14.995660 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:26:14.995660 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:26:14.995660 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:26:14.995660 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:26:14.995660 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application with Lock( Aug 09 16:26:14.995660 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:26:14.995660 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:26:14.995660 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:26:14.995660 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:26:14.996402 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:26:14.996402 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:26:14.996402 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:26:14.996402 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:26:14.996402 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 16:26:14.996402 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 16:26:14.996402 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 16:26:14.996402 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 16:26:14.996402 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 16:26:14.996402 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 16:26:14.996402 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 16:26:14.996402 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Aug 09 16:26:14.999711 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 60/122] 10.222.0.104 () {56 vars in 1101 bytes} [Tue Aug 9 16:26:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 16:26:15.001049 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b456fa7-7e21-4cb2-9213-0e08cd53c9d3 None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:15.031950 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.auth.core [None req-b2a8128a-3c84-40ca-aa87-022dbadd9be8 None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:26:15.034672 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.fernet_utils [None req-b2a8128a-3c84-40ca-aa87-022dbadd9be8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:26:15.082512 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:15.181266 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b456fa7-7e21-4cb2-9213-0e08cd53c9d3 None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:15.187522 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 63/123] 10.222.0.104 () {58 vars in 1029 bytes} [Tue Aug 9 16:26:14 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 16:26:15.193471 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a8128a-3c84-40ca-aa87-022dbadd9be8 None None] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:15.224009 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da0eaa6-83d7-46ac-b511-427e91ee491c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:15.224648 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da0eaa6-83d7-46ac-b511-427e91ee491c None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:15.224923 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da0eaa6-83d7-46ac-b511-427e91ee491c None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:15.225240 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da0eaa6-83d7-46ac-b511-427e91ee491c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:15.239957 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da0eaa6-83d7-46ac-b511-427e91ee491c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 16:26:15.245288 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application [None req-7da0eaa6-83d7-46ac-b511-427e91ee491c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 16:26:15.245288 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:26:15.245288 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:26:15.245288 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:26:15.245288 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:26:15.245288 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:26:15.245288 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:26:15.245288 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:26:15.245288 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:26:15.245288 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:26:15.245288 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:26:15.245288 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:26:15.245288 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 16:26:15.245288 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 16:26:15.245288 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 16:26:15.245288 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 16:26:15.246197 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 16:26:15.246197 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 16:26:15.246197 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 16:26:15.246197 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 16:26:15.246197 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:26:15.246197 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:26:15.246197 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:26:15.246197 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:26:15.246197 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:26:15.246197 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:26:15.246197 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:26:15.246197 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application with Lock( Aug 09 16:26:15.246197 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:26:15.246197 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:26:15.246197 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:26:15.246197 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:26:15.246959 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:26:15.246959 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:26:15.246959 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:26:15.246959 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:26:15.246959 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 16:26:15.246959 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 16:26:15.246959 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 16:26:15.246959 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 16:26:15.246959 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 16:26:15.246959 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 16:26:15.246959 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 16:26:15.246959 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Aug 09 16:26:15.248092 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 61/124] 10.222.0.104 () {56 vars in 1119 bytes} [Tue Aug 9 16:26:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 16:26:15.248514 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da0eaa6-83d7-46ac-b511-427e91ee491c None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:15.296255 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:15.325820 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a8128a-3c84-40ca-aa87-022dbadd9be8 None None] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:15.370187 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61201d2-2227-4b13-b7f0-82522f3ab8a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:15.370942 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61201d2-2227-4b13-b7f0-82522f3ab8a5 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:15.371179 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61201d2-2227-4b13-b7f0-82522f3ab8a5 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:15.371566 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61201d2-2227-4b13-b7f0-82522f3ab8a5 None admin] PATH_INFO: `/v3/roles` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:15.372234 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61201d2-2227-4b13-b7f0-82522f3ab8a5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:26:15.372753 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61201d2-2227-4b13-b7f0-82522f3ab8a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:15.374151 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61201d2-2227-4b13-b7f0-82522f3ab8a5 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:15.393626 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 64/125] 10.222.0.104 () {56 vars in 1104 bytes} [Tue Aug 9 16:26:15 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:26:15.394527 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61201d2-2227-4b13-b7f0-82522f3ab8a5 None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:15.439383 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:15.444043 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da0eaa6-83d7-46ac-b511-427e91ee491c None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:15.500011 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1f1e1a-6b60-48d1-9763-3ab6a34adecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:15.500654 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1f1e1a-6b60-48d1-9763-3ab6a34adecc None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:15.500939 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1f1e1a-6b60-48d1-9763-3ab6a34adecc None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:15.501216 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1f1e1a-6b60-48d1-9763-3ab6a34adecc None admin] PATH_INFO: `/v3/roles/member` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:15.511947 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1f1e1a-6b60-48d1-9763-3ab6a34adecc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 16:26:15.516759 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application [None req-4f1f1e1a-6b60-48d1-9763-3ab6a34adecc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 09 16:26:15.516759 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:26:15.516759 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:26:15.516759 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:26:15.516759 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:26:15.516759 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:26:15.516759 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:26:15.516759 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:26:15.516759 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:26:15.516759 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:26:15.516759 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:26:15.516759 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:26:15.516759 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 16:26:15.516759 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 16:26:15.516759 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 16:26:15.516759 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 16:26:15.517642 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 16:26:15.517642 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 16:26:15.517642 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 16:26:15.517642 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 16:26:15.517642 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:26:15.517642 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:26:15.517642 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:26:15.517642 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:26:15.517642 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:26:15.517642 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:26:15.517642 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:26:15.517642 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application with Lock( Aug 09 16:26:15.517642 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:26:15.517642 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:26:15.517642 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:26:15.517642 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:26:15.519868 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:26:15.519868 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:26:15.519868 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:26:15.519868 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:26:15.519868 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 16:26:15.519868 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 16:26:15.519868 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 16:26:15.519868 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 16:26:15.519868 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 16:26:15.519868 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 16:26:15.519868 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 09 16:26:15.519868 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Aug 09 16:26:15.519868 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 62/126] 10.222.0.104 () {56 vars in 1104 bytes} [Tue Aug 9 16:26:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 16:26:15.519868 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1f1e1a-6b60-48d1-9763-3ab6a34adecc None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:15.595833 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61201d2-2227-4b13-b7f0-82522f3ab8a5 None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:15.612099 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:15.628213 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1f1e1a-6b60-48d1-9763-3ab6a34adecc None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:15.665860 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da284a98-7036-46f1-8017-075f981ea72f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:15.666745 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da284a98-7036-46f1-8017-075f981ea72f None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:15.667033 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da284a98-7036-46f1-8017-075f981ea72f None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:15.667357 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da284a98-7036-46f1-8017-075f981ea72f None admin] PATH_INFO: `/v3/users/cd0c59114b4e47af86cbee7e2a704cf6` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:15.671883 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da284a98-7036-46f1-8017-075f981ea72f None admin] RBAC: Authorizing `identity:get_user(user_id=cd0c59114b4e47af86cbee7e2a704cf6)` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:15.673349 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da284a98-7036-46f1-8017-075f981ea72f None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:15.674959 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 63/127] 10.222.0.104 () {56 vars in 1182 bytes} [Tue Aug 9 16:26:15 2022] GET /identity/v3/users/cd0c59114b4e47af86cbee7e2a704cf6 => generated 248 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:26:15.675725 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da284a98-7036-46f1-8017-075f981ea72f None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:15.686314 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042041c1-99cd-45e1-83a5-188224f3d51e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:15.686955 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042041c1-99cd-45e1-83a5-188224f3d51e None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:15.687232 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042041c1-99cd-45e1-83a5-188224f3d51e None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:15.687507 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042041c1-99cd-45e1-83a5-188224f3d51e None admin] PATH_INFO: `/v3/roles` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:15.688357 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042041c1-99cd-45e1-83a5-188224f3d51e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:26:15.688660 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042041c1-99cd-45e1-83a5-188224f3d51e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:15.690733 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042041c1-99cd-45e1-83a5-188224f3d51e None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:15.708160 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 65/128] 10.222.0.104 () {56 vars in 1116 bytes} [Tue Aug 9 16:26:15 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:26:15.709076 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042041c1-99cd-45e1-83a5-188224f3d51e None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:15.804051 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da284a98-7036-46f1-8017-075f981ea72f None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:15.868968 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d45b4fd-6d1b-49dc-9629-a984a31cfb35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:15.869632 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d45b4fd-6d1b-49dc-9629-a984a31cfb35 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:15.869997 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d45b4fd-6d1b-49dc-9629-a984a31cfb35 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:15.870254 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d45b4fd-6d1b-49dc-9629-a984a31cfb35 None admin] PATH_INFO: `/v3/roles` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:15.870920 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d45b4fd-6d1b-49dc-9629-a984a31cfb35 None admin] RBAC: Adding query filter params (name=member) {{(pid=87276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:26:15.871224 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d45b4fd-6d1b-49dc-9629-a984a31cfb35 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:15.872597 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d45b4fd-6d1b-49dc-9629-a984a31cfb35 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:15.885149 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:15.889068 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 64/129] 10.222.0.104 () {56 vars in 1106 bytes} [Tue Aug 9 16:26:15 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:26:15.889886 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d45b4fd-6d1b-49dc-9629-a984a31cfb35 None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:15.933983 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042041c1-99cd-45e1-83a5-188224f3d51e None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:15.939205 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:16.037112 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93f522a-ab74-4384-89f2-bafa8d520a49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:16.037761 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93f522a-ab74-4384-89f2-bafa8d520a49 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:16.038071 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93f522a-ab74-4384-89f2-bafa8d520a49 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:16.039159 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93f522a-ab74-4384-89f2-bafa8d520a49 None admin] PATH_INFO: `/v3/projects/8e08184221014bc3bf771cdbe24c6720` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:16.040315 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93f522a-ab74-4384-89f2-bafa8d520a49 None admin] RBAC: Authorizing `identity:get_project(project_id=8e08184221014bc3bf771cdbe24c6720)` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:16.041799 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93f522a-ab74-4384-89f2-bafa8d520a49 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:16.047279 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 66/130] 10.222.0.104 () {56 vars in 1191 bytes} [Tue Aug 9 16:26:15 2022] GET /identity/v3/projects/8e08184221014bc3bf771cdbe24c6720 => generated 299 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:26:16.050092 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93f522a-ab74-4384-89f2-bafa8d520a49 None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:16.208100 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d45b4fd-6d1b-49dc-9629-a984a31cfb35 None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:16.256919 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7494996d-6225-4a58-9b14-3a41cfff68d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:16.257562 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7494996d-6225-4a58-9b14-3a41cfff68d6 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:16.257914 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7494996d-6225-4a58-9b14-3a41cfff68d6 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:16.258214 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7494996d-6225-4a58-9b14-3a41cfff68d6 None admin] PATH_INFO: `/v3/users/90e486c670fa4bac812f14eb300edcae` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:16.259367 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7494996d-6225-4a58-9b14-3a41cfff68d6 None admin] RBAC: Authorizing `identity:get_user(user_id=90e486c670fa4bac812f14eb300edcae)` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:16.260825 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7494996d-6225-4a58-9b14-3a41cfff68d6 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:16.262962 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 65/131] 10.222.0.104 () {56 vars in 1182 bytes} [Tue Aug 9 16:26:15 2022] GET /identity/v3/users/90e486c670fa4bac812f14eb300edcae => generated 276 bytes in 373 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:26:16.263612 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7494996d-6225-4a58-9b14-3a41cfff68d6 None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:16.270734 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93f522a-ab74-4384-89f2-bafa8d520a49 None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:16.351264 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f769d5-45a3-459b-a775-40edf61c6aa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:16.351935 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f769d5-45a3-459b-a775-40edf61c6aa7 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:16.352255 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f769d5-45a3-459b-a775-40edf61c6aa7 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:16.352496 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f769d5-45a3-459b-a775-40edf61c6aa7 None admin] PATH_INFO: `/v3/users/90e486c670fa4bac812f14eb300edcae` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:16.355664 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f769d5-45a3-459b-a775-40edf61c6aa7 None admin] RBAC: Authorizing `identity:get_user(user_id=90e486c670fa4bac812f14eb300edcae)` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:16.357123 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f769d5-45a3-459b-a775-40edf61c6aa7 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:16.363136 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 67/132] 10.222.0.104 () {56 vars in 1182 bytes} [Tue Aug 9 16:26:16 2022] GET /identity/v3/users/90e486c670fa4bac812f14eb300edcae => generated 276 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:26:16.363645 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f769d5-45a3-459b-a775-40edf61c6aa7 None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:16.394270 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:16.506344 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:16.526940 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7494996d-6225-4a58-9b14-3a41cfff68d6 None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:16.577051 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f769d5-45a3-459b-a775-40edf61c6aa7 None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:16.594284 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdbf374-0019-4920-84af-20307b74f8f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:16.594956 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdbf374-0019-4920-84af-20307b74f8f4 None admin] REQUEST_METHOD: `PUT` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:16.595233 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdbf374-0019-4920-84af-20307b74f8f4 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:16.595506 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdbf374-0019-4920-84af-20307b74f8f4 None admin] PATH_INFO: `/v3/projects/8e08184221014bc3bf771cdbe24c6720/users/cd0c59114b4e47af86cbee7e2a704cf6/roles/c0143e35c1344a39a931bbb6bcd5acdc` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:16.599990 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdbf374-0019-4920-84af-20307b74f8f4 None admin] RBAC: Authorizing `identity:create_grant(project_id=8e08184221014bc3bf771cdbe24c6720, user_id=cd0c59114b4e47af86cbee7e2a704cf6, role_id=c0143e35c1344a39a931bbb6bcd5acdc)` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:16.601735 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdbf374-0019-4920-84af-20307b74f8f4 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:16.628464 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 66/133] 10.222.0.104 () {58 vars in 1444 bytes} [Tue Aug 9 16:26:16 2022] PUT /identity/v3/projects/8e08184221014bc3bf771cdbe24c6720/users/cd0c59114b4e47af86cbee7e2a704cf6/roles/c0143e35c1344a39a931bbb6bcd5acdc => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 16:26:16.630236 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdbf374-0019-4920-84af-20307b74f8f4 None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:16.650893 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11f6cd9-9cf8-49db-b122-504296d7fced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:16.651616 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11f6cd9-9cf8-49db-b122-504296d7fced None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:16.651948 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11f6cd9-9cf8-49db-b122-504296d7fced None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:16.652222 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11f6cd9-9cf8-49db-b122-504296d7fced None admin] PATH_INFO: `/v3/projects/8e08184221014bc3bf771cdbe24c6720` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:16.654465 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11f6cd9-9cf8-49db-b122-504296d7fced None admin] RBAC: Authorizing `identity:get_project(project_id=8e08184221014bc3bf771cdbe24c6720)` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:16.656645 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11f6cd9-9cf8-49db-b122-504296d7fced None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:16.659498 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 68/134] 10.222.0.104 () {56 vars in 1191 bytes} [Tue Aug 9 16:26:16 2022] GET /identity/v3/projects/8e08184221014bc3bf771cdbe24c6720 => generated 299 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:26:16.665034 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11f6cd9-9cf8-49db-b122-504296d7fced None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:16.831618 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdbf374-0019-4920-84af-20307b74f8f4 None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:16.847359 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:16.882243 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11f6cd9-9cf8-49db-b122-504296d7fced None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:16.903538 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe2a0a2-0196-4c08-a3a0-2672206f6fa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:16.904233 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe2a0a2-0196-4c08-a3a0-2672206f6fa5 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:16.904506 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe2a0a2-0196-4c08-a3a0-2672206f6fa5 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:16.904775 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe2a0a2-0196-4c08-a3a0-2672206f6fa5 None admin] PATH_INFO: `/v3/projects/2966cedde9c44486bcb32a457df8d6c5` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:16.906079 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe2a0a2-0196-4c08-a3a0-2672206f6fa5 None admin] RBAC: Authorizing `identity:get_project(project_id=2966cedde9c44486bcb32a457df8d6c5)` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:16.907690 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe2a0a2-0196-4c08-a3a0-2672206f6fa5 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:16.910447 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 67/135] 10.222.0.104 () {56 vars in 1191 bytes} [Tue Aug 9 16:26:16 2022] GET /identity/v3/projects/2966cedde9c44486bcb32a457df8d6c5 => generated 313 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:26:16.911649 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af64535-dd5d-434c-a625-5541395abc32 None None] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:16.911939 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af64535-dd5d-434c-a625-5541395abc32 None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:16.912209 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af64535-dd5d-434c-a625-5541395abc32 None None] PATH_INFO: `/` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:16.913615 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 68/136] 10.222.0.104 () {54 vars in 932 bytes} [Tue Aug 9 16:26:16 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:26:16.917312 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af64535-dd5d-434c-a625-5541395abc32 None None] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:16.925985 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7113e042-c292-4f7b-8877-e943f8bde57f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:16.926659 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7113e042-c292-4f7b-8877-e943f8bde57f None admin] REQUEST_METHOD: `PUT` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:16.926936 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7113e042-c292-4f7b-8877-e943f8bde57f None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:16.927205 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7113e042-c292-4f7b-8877-e943f8bde57f None admin] PATH_INFO: `/v3/projects/8e08184221014bc3bf771cdbe24c6720/users/90e486c670fa4bac812f14eb300edcae/roles/8a954d5b81f74df1985780d968ff3073` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:16.929614 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7113e042-c292-4f7b-8877-e943f8bde57f None admin] RBAC: Authorizing `identity:create_grant(project_id=8e08184221014bc3bf771cdbe24c6720, user_id=90e486c670fa4bac812f14eb300edcae, role_id=8a954d5b81f74df1985780d968ff3073)` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:16.931310 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7113e042-c292-4f7b-8877-e943f8bde57f None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:16.935704 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:16.952324 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 69/137] 10.222.0.104 () {58 vars in 1444 bytes} [Tue Aug 9 16:26:16 2022] PUT /identity/v3/projects/8e08184221014bc3bf771cdbe24c6720/users/90e486c670fa4bac812f14eb300edcae/roles/8a954d5b81f74df1985780d968ff3073 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 16:26:16.954161 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86c4023-fd5c-44b8-bf86-4bf827f46d43 None None] REQUEST_METHOD: `POST` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:16.954500 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86c4023-fd5c-44b8-bf86-4bf827f46d43 None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:16.954775 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86c4023-fd5c-44b8-bf86-4bf827f46d43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:16.987824 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.auth.core [None req-a86c4023-fd5c-44b8-bf86-4bf827f46d43 None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:26:16.989049 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.fernet_utils [None req-a86c4023-fd5c-44b8-bf86-4bf827f46d43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:26:17.118538 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af64535-dd5d-434c-a625-5541395abc32 None None] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:17.148022 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 70/138] 10.222.0.104 () {58 vars in 1029 bytes} [Tue Aug 9 16:26:16 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 16:26:17.188649 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c020a0ba-8698-480f-ad18-bf684a50edef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:17.189351 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c020a0ba-8698-480f-ad18-bf684a50edef None admin] REQUEST_METHOD: `PUT` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:17.190185 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c020a0ba-8698-480f-ad18-bf684a50edef None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:17.190460 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c020a0ba-8698-480f-ad18-bf684a50edef None admin] PATH_INFO: `/v3/projects/2966cedde9c44486bcb32a457df8d6c5/users/90e486c670fa4bac812f14eb300edcae/roles/044ca4f80141492b9c128ada543865e8` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:17.192516 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c020a0ba-8698-480f-ad18-bf684a50edef None admin] RBAC: Authorizing `identity:create_grant(project_id=2966cedde9c44486bcb32a457df8d6c5, user_id=90e486c670fa4bac812f14eb300edcae, role_id=044ca4f80141492b9c128ada543865e8)` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:17.194114 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c020a0ba-8698-480f-ad18-bf684a50edef None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:17.219233 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 69/139] 10.222.0.104 () {58 vars in 1444 bytes} [Tue Aug 9 16:26:16 2022] PUT /identity/v3/projects/2966cedde9c44486bcb32a457df8d6c5/users/90e486c670fa4bac812f14eb300edcae/roles/044ca4f80141492b9c128ada543865e8 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 16:26:17.232550 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86c4023-fd5c-44b8-bf86-4bf827f46d43 None None] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:17.318375 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:17.360470 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86c4023-fd5c-44b8-bf86-4bf827f46d43 None None] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:17.404062 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be54a80-d3f7-402f-b92d-bf6616eacd91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:17.404664 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be54a80-d3f7-402f-b92d-bf6616eacd91 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:17.404897 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be54a80-d3f7-402f-b92d-bf6616eacd91 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:17.405170 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be54a80-d3f7-402f-b92d-bf6616eacd91 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:17.410785 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be54a80-d3f7-402f-b92d-bf6616eacd91 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:17.412290 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be54a80-d3f7-402f-b92d-bf6616eacd91 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:17.414359 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 71/140] 10.222.0.104 () {56 vars in 1113 bytes} [Tue Aug 9 16:26:17 2022] GET /identity/v3/domains/default => generated 200 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:26:17.419857 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c020a0ba-8698-480f-ad18-bf684a50edef None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:17.520009 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:17.561139 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c020a0ba-8698-480f-ad18-bf684a50edef None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:17.601685 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90bebef-d579-48d0-9f76-e01937f5b0cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:17.602338 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90bebef-d579-48d0-9f76-e01937f5b0cd None admin] REQUEST_METHOD: `POST` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:17.602621 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90bebef-d579-48d0-9f76-e01937f5b0cd None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:17.602892 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90bebef-d579-48d0-9f76-e01937f5b0cd None admin] PATH_INFO: `/v3/users` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:17.603551 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90bebef-d579-48d0-9f76-e01937f5b0cd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:17.605060 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90bebef-d579-48d0-9f76-e01937f5b0cd None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:17.635826 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 70/141] 10.222.0.104 () {60 vars in 1137 bytes} [Tue Aug 9 16:26:17 2022] POST /identity/v3/users => generated 284 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 16:26:17.639035 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9a5c57-7428-466d-88a6-28196e378943 None None] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:17.639324 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9a5c57-7428-466d-88a6-28196e378943 None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:17.639727 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9a5c57-7428-466d-88a6-28196e378943 None None] PATH_INFO: `/` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:17.641094 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 72/142] 10.222.0.104 () {54 vars in 932 bytes} [Tue Aug 9 16:26:17 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:26:17.649703 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da449113-3976-498f-b69f-00b371b0f4c5 None None] REQUEST_METHOD: `POST` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:17.650026 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da449113-3976-498f-b69f-00b371b0f4c5 None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:17.650280 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da449113-3976-498f-b69f-00b371b0f4c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:17.669882 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.auth.core [None req-da449113-3976-498f-b69f-00b371b0f4c5 None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:26:17.671113 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.fernet_utils [None req-da449113-3976-498f-b69f-00b371b0f4c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:26:17.753400 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 71/143] 10.222.0.104 () {58 vars in 1029 bytes} [Tue Aug 9 16:26:17 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 16:26:17.816226 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9a5c57-7428-466d-88a6-28196e378943 None None] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:17.935419 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9a5c57-7428-466d-88a6-28196e378943 None None] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:17.980207 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0bb49d-8f40-4b05-b852-5ff02bc7dce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:17.980912 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0bb49d-8f40-4b05-b852-5ff02bc7dce3 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:17.981195 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0bb49d-8f40-4b05-b852-5ff02bc7dce3 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:17.981470 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0bb49d-8f40-4b05-b852-5ff02bc7dce3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:17.994489 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:17.998877 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0bb49d-8f40-4b05-b852-5ff02bc7dce3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 16:26:18.004312 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application [None req-1b0bb49d-8f40-4b05-b852-5ff02bc7dce3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 09 16:26:18.004312 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:26:18.004312 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:26:18.004312 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:26:18.004312 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:26:18.004312 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:26:18.004312 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:26:18.004312 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:26:18.004312 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:26:18.004312 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:26:18.004312 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:26:18.004312 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:26:18.004312 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 16:26:18.004312 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 16:26:18.004312 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 16:26:18.004312 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 16:26:18.005157 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 16:26:18.005157 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 16:26:18.005157 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 16:26:18.005157 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 16:26:18.005157 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:26:18.005157 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:26:18.005157 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:26:18.005157 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:26:18.005157 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:26:18.005157 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:26:18.005157 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:26:18.005157 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application with Lock( Aug 09 16:26:18.005157 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:26:18.005157 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:26:18.005157 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:26:18.005157 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:26:18.005975 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:26:18.005975 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:26:18.005975 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:26:18.005975 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:26:18.005975 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 16:26:18.005975 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 16:26:18.005975 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 16:26:18.005975 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 16:26:18.005975 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 16:26:18.005975 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 16:26:18.005975 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 09 16:26:18.005975 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Aug 09 16:26:18.005975 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 73/144] 10.222.0.104 () {56 vars in 1104 bytes} [Tue Aug 9 16:26:17 2022] GET /identity/v3/roles/reader => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 16:26:18.011613 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da449113-3976-498f-b69f-00b371b0f4c5 None None] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:18.078599 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:18.124669 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da449113-3976-498f-b69f-00b371b0f4c5 None None] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:18.161962 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96d6fe4-3c1b-4f43-82a4-9b4e1fc5928f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:18.162642 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96d6fe4-3c1b-4f43-82a4-9b4e1fc5928f None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:18.162920 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96d6fe4-3c1b-4f43-82a4-9b4e1fc5928f None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:18.163193 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96d6fe4-3c1b-4f43-82a4-9b4e1fc5928f None admin] PATH_INFO: `/v3/roles` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:18.163854 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96d6fe4-3c1b-4f43-82a4-9b4e1fc5928f None admin] RBAC: Adding query filter params (name=reader) {{(pid=87276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:26:18.164152 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96d6fe4-3c1b-4f43-82a4-9b4e1fc5928f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:18.165520 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96d6fe4-3c1b-4f43-82a4-9b4e1fc5928f None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:18.175472 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 72/145] 10.222.0.104 () {56 vars in 1106 bytes} [Tue Aug 9 16:26:18 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:26:18.181076 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0bb49d-8f40-4b05-b852-5ff02bc7dce3 None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:18.211087 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2798e51c-7bd1-444e-a169-1360fcadb9da None None] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:18.211373 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2798e51c-7bd1-444e-a169-1360fcadb9da None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:18.211560 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2798e51c-7bd1-444e-a169-1360fcadb9da None None] PATH_INFO: `/` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:18.212923 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 73/146] 10.222.0.104 () {54 vars in 932 bytes} [Tue Aug 9 16:26:18 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 09 16:26:18.217889 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635a207c-8fdf-4add-91b3-9e09ff336d68 None None] REQUEST_METHOD: `POST` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:18.218203 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635a207c-8fdf-4add-91b3-9e09ff336d68 None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:18.218471 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635a207c-8fdf-4add-91b3-9e09ff336d68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:18.244451 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.auth.core [None req-635a207c-8fdf-4add-91b3-9e09ff336d68 None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:26:18.245631 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.fernet_utils [None req-635a207c-8fdf-4add-91b3-9e09ff336d68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:26:18.331333 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 74/147] 10.222.0.104 () {58 vars in 1029 bytes} [Tue Aug 9 16:26:18 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 16:26:18.339297 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0bb49d-8f40-4b05-b852-5ff02bc7dce3 None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:18.369631 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635a207c-8fdf-4add-91b3-9e09ff336d68 None None] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:18.380521 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c723b8-35e0-4344-acb3-82d3d75386eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:18.381169 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c723b8-35e0-4344-acb3-82d3d75386eb None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:18.381444 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c723b8-35e0-4344-acb3-82d3d75386eb None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:18.381712 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c723b8-35e0-4344-acb3-82d3d75386eb None admin] PATH_INFO: `/v3/users/76f408bb21ec48ebba9692c37ae07061` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:18.386610 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c723b8-35e0-4344-acb3-82d3d75386eb None admin] RBAC: Authorizing `identity:get_user(user_id=76f408bb21ec48ebba9692c37ae07061)` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:18.388085 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c723b8-35e0-4344-acb3-82d3d75386eb None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:18.390057 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 74/148] 10.222.0.104 () {56 vars in 1182 bytes} [Tue Aug 9 16:26:18 2022] GET /identity/v3/users/76f408bb21ec48ebba9692c37ae07061 => generated 290 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:26:18.398017 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c723b8-35e0-4344-acb3-82d3d75386eb None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:18.442279 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:18.492237 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635a207c-8fdf-4add-91b3-9e09ff336d68 None None] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:18.525741 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:18.532411 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81bbe04-0f2b-44d1-a9d1-0980d1827f2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:18.533710 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81bbe04-0f2b-44d1-a9d1-0980d1827f2a None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:18.534118 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81bbe04-0f2b-44d1-a9d1-0980d1827f2a None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:18.534395 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81bbe04-0f2b-44d1-a9d1-0980d1827f2a None admin] PATH_INFO: `/v3/roles/member` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:18.547936 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81bbe04-0f2b-44d1-a9d1-0980d1827f2a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 16:26:18.554199 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application [None req-e81bbe04-0f2b-44d1-a9d1-0980d1827f2a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 09 16:26:18.554199 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:26:18.554199 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:26:18.554199 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:26:18.554199 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:26:18.554199 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:26:18.554199 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:26:18.554199 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:26:18.554199 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:26:18.554199 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:26:18.554199 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:26:18.554199 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:26:18.554199 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 16:26:18.554199 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 16:26:18.554199 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 16:26:18.554199 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 16:26:18.555098 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 16:26:18.555098 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 16:26:18.555098 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 16:26:18.555098 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 16:26:18.555098 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:26:18.555098 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:26:18.555098 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:26:18.555098 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:26:18.555098 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:26:18.555098 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:26:18.555098 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:26:18.555098 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application with Lock( Aug 09 16:26:18.555098 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:26:18.555098 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:26:18.555098 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:26:18.555098 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:26:18.555858 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:26:18.555858 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:26:18.555858 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:26:18.555858 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:26:18.555858 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 16:26:18.555858 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 16:26:18.555858 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 16:26:18.555858 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 16:26:18.555858 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 16:26:18.555858 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 16:26:18.555858 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 09 16:26:18.555858 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Aug 09 16:26:18.555858 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 75/149] 10.222.0.104 () {56 vars in 1104 bytes} [Tue Aug 9 16:26:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 16:26:18.576345 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81bbe04-0f2b-44d1-a9d1-0980d1827f2a None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:18.579253 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c723b8-35e0-4344-acb3-82d3d75386eb None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:18.621338 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5669fb09-03f8-4c50-87b4-4d0f0f867937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:18.622025 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5669fb09-03f8-4c50-87b4-4d0f0f867937 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:18.622306 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5669fb09-03f8-4c50-87b4-4d0f0f867937 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:18.622576 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5669fb09-03f8-4c50-87b4-4d0f0f867937 None admin] PATH_INFO: `/v3/projects/8e08184221014bc3bf771cdbe24c6720` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:18.623814 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5669fb09-03f8-4c50-87b4-4d0f0f867937 None admin] RBAC: Authorizing `identity:get_project(project_id=8e08184221014bc3bf771cdbe24c6720)` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:18.626425 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5669fb09-03f8-4c50-87b4-4d0f0f867937 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:18.628703 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 75/150] 10.222.0.104 () {56 vars in 1191 bytes} [Tue Aug 9 16:26:18 2022] GET /identity/v3/projects/8e08184221014bc3bf771cdbe24c6720 => generated 299 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 16:26:18.636711 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5669fb09-03f8-4c50-87b4-4d0f0f867937 None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:18.761006 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81bbe04-0f2b-44d1-a9d1-0980d1827f2a None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:18.780184 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:18.787474 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5669fb09-03f8-4c50-87b4-4d0f0f867937 None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:18.828191 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70ed621-e8a2-49b8-9668-df1d6b572bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:18.828807 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70ed621-e8a2-49b8-9668-df1d6b572bc2 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:18.829133 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70ed621-e8a2-49b8-9668-df1d6b572bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:18.829409 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70ed621-e8a2-49b8-9668-df1d6b572bc2 None admin] PATH_INFO: `/v3/roles` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:18.830122 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70ed621-e8a2-49b8-9668-df1d6b572bc2 None admin] RBAC: Adding query filter params (name=member) {{(pid=87276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:26:18.830524 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70ed621-e8a2-49b8-9668-df1d6b572bc2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:18.832004 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70ed621-e8a2-49b8-9668-df1d6b572bc2 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:18.847292 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012b6b57-b6b1-4bc8-a651-01820caa2f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:18.847960 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012b6b57-b6b1-4bc8-a651-01820caa2f75 None admin] REQUEST_METHOD: `PUT` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:18.848238 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012b6b57-b6b1-4bc8-a651-01820caa2f75 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:18.848507 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012b6b57-b6b1-4bc8-a651-01820caa2f75 None admin] PATH_INFO: `/v3/projects/8e08184221014bc3bf771cdbe24c6720/users/76f408bb21ec48ebba9692c37ae07061/roles/92a80348b6cb4bb38f2a6a9f5facb705` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:18.851004 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012b6b57-b6b1-4bc8-a651-01820caa2f75 None admin] RBAC: Authorizing `identity:create_grant(project_id=8e08184221014bc3bf771cdbe24c6720, user_id=76f408bb21ec48ebba9692c37ae07061, role_id=92a80348b6cb4bb38f2a6a9f5facb705)` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:18.852537 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012b6b57-b6b1-4bc8-a651-01820caa2f75 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:18.854815 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 76/151] 10.222.0.104 () {56 vars in 1106 bytes} [Tue Aug 9 16:26:18 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 16:26:18.857283 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:18.863134 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70ed621-e8a2-49b8-9668-df1d6b572bc2 None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:18.880096 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 76/152] 10.222.0.104 () {58 vars in 1444 bytes} [Tue Aug 9 16:26:18 2022] PUT /identity/v3/projects/8e08184221014bc3bf771cdbe24c6720/users/76f408bb21ec48ebba9692c37ae07061/roles/92a80348b6cb4bb38f2a6a9f5facb705 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 16:26:19.029746 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70ed621-e8a2-49b8-9668-df1d6b572bc2 None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:19.081110 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969ebd11-7ac4-49aa-8fa6-27be94730411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:19.081762 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969ebd11-7ac4-49aa-8fa6-27be94730411 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:19.082067 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969ebd11-7ac4-49aa-8fa6-27be94730411 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:19.082342 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969ebd11-7ac4-49aa-8fa6-27be94730411 None admin] PATH_INFO: `/v3/users/90e486c670fa4bac812f14eb300edcae` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:19.083515 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969ebd11-7ac4-49aa-8fa6-27be94730411 None admin] RBAC: Authorizing `identity:get_user(user_id=90e486c670fa4bac812f14eb300edcae)` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:19.084997 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969ebd11-7ac4-49aa-8fa6-27be94730411 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:19.086658 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 77/153] 10.222.0.104 () {56 vars in 1182 bytes} [Tue Aug 9 16:26:18 2022] GET /identity/v3/users/90e486c670fa4bac812f14eb300edcae => generated 276 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:26:19.092467 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012b6b57-b6b1-4bc8-a651-01820caa2f75 None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:19.219638 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012b6b57-b6b1-4bc8-a651-01820caa2f75 None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:19.264851 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090016db-8ba5-468e-8e5e-195222692f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:19.265475 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090016db-8ba5-468e-8e5e-195222692f16 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:19.265755 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090016db-8ba5-468e-8e5e-195222692f16 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:19.266064 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090016db-8ba5-468e-8e5e-195222692f16 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:19.341566 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:19.352999 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090016db-8ba5-468e-8e5e-195222692f16 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:19.354532 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090016db-8ba5-468e-8e5e-195222692f16 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:19.465614 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 77/154] 10.222.0.104 () {58 vars in 1287 bytes} [Tue Aug 9 16:26:19 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 09 16:26:19.472167 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969ebd11-7ac4-49aa-8fa6-27be94730411 None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:19.527307 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:19.606037 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969ebd11-7ac4-49aa-8fa6-27be94730411 None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:19.648569 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b4ca3c-c6c7-46fd-8d08-4aeb5c4f9668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:19.649210 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b4ca3c-c6c7-46fd-8d08-4aeb5c4f9668 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:19.649487 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b4ca3c-c6c7-46fd-8d08-4aeb5c4f9668 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:19.649768 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b4ca3c-c6c7-46fd-8d08-4aeb5c4f9668 None admin] PATH_INFO: `/v3/projects/8e08184221014bc3bf771cdbe24c6720` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:19.650990 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b4ca3c-c6c7-46fd-8d08-4aeb5c4f9668 None admin] RBAC: Authorizing `identity:get_project(project_id=8e08184221014bc3bf771cdbe24c6720)` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:19.652434 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b4ca3c-c6c7-46fd-8d08-4aeb5c4f9668 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:19.654566 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 78/155] 10.222.0.104 () {56 vars in 1191 bytes} [Tue Aug 9 16:26:19 2022] GET /identity/v3/projects/8e08184221014bc3bf771cdbe24c6720 => generated 299 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:26:19.660813 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090016db-8ba5-468e-8e5e-195222692f16 None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:19.777926 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090016db-8ba5-468e-8e5e-195222692f16 None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:19.792630 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:19.821208 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cf7a8a-852a-4956-a347-6ee4852e7fa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:19.821815 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cf7a8a-852a-4956-a347-6ee4852e7fa7 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:19.822127 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cf7a8a-852a-4956-a347-6ee4852e7fa7 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:19.822400 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cf7a8a-852a-4956-a347-6ee4852e7fa7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:19.823131 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cf7a8a-852a-4956-a347-6ee4852e7fa7 None admin] RBAC: Adding query filter params (role.id=044ca4f80141492b9c128ada543865e8, scope.project.id=8e08184221014bc3bf771cdbe24c6720, user.id=90e486c670fa4bac812f14eb300edcae) {{(pid=87275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:26:19.823435 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cf7a8a-852a-4956-a347-6ee4852e7fa7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:19.824868 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cf7a8a-852a-4956-a347-6ee4852e7fa7 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:19.831738 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 78/156] 10.222.0.104 () {56 vars in 1379 bytes} [Tue Aug 9 16:26:19 2022] GET /identity/v3/role_assignments?user.id=90e486c670fa4bac812f14eb300edcae&scope.project.id=8e08184221014bc3bf771cdbe24c6720&role.id=044ca4f80141492b9c128ada543865e8 => generated 610 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:26:20.457441 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2059e49-f373-4063-84ba-5fcc7fe8bbcb None None] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:20.457843 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2059e49-f373-4063-84ba-5fcc7fe8bbcb None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:20.458043 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2059e49-f373-4063-84ba-5fcc7fe8bbcb None None] PATH_INFO: `/` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:20.459605 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 79/157] 10.222.0.104 () {54 vars in 932 bytes} [Tue Aug 9 16:26:20 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:26:20.464645 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22df1380-e4c5-4e42-98ae-42aa582f9a75 None None] REQUEST_METHOD: `POST` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:20.464935 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22df1380-e4c5-4e42-98ae-42aa582f9a75 None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:20.465211 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22df1380-e4c5-4e42-98ae-42aa582f9a75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:20.490963 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.auth.core [None req-22df1380-e4c5-4e42-98ae-42aa582f9a75 None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:26:20.492178 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.fernet_utils [None req-22df1380-e4c5-4e42-98ae-42aa582f9a75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:26:20.582711 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 79/158] 10.222.0.104 () {58 vars in 1029 bytes} [Tue Aug 9 16:26:20 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 16:26:20.613583 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2059e49-f373-4063-84ba-5fcc7fe8bbcb None None] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:20.747550 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2059e49-f373-4063-84ba-5fcc7fe8bbcb None None] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:20.773175 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:20.799197 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3490a5-1cc7-436e-a1a0-cfc6b379b05e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:20.799847 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3490a5-1cc7-436e-a1a0-cfc6b379b05e None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:20.800122 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3490a5-1cc7-436e-a1a0-cfc6b379b05e None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:20.800390 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3490a5-1cc7-436e-a1a0-cfc6b379b05e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:20.817372 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3490a5-1cc7-436e-a1a0-cfc6b379b05e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 16:26:20.822133 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application [None req-ec3490a5-1cc7-436e-a1a0-cfc6b379b05e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 16:26:20.822133 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:26:20.822133 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:26:20.822133 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:26:20.822133 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:26:20.822133 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:26:20.822133 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:26:20.822133 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:26:20.822133 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:26:20.822133 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:26:20.822133 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:26:20.822133 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:26:20.822133 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 16:26:20.822133 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 16:26:20.822133 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 16:26:20.822133 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 16:26:20.822985 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 16:26:20.822985 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 16:26:20.822985 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 16:26:20.822985 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 16:26:20.822985 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:26:20.822985 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:26:20.822985 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:26:20.822985 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:26:20.822985 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:26:20.822985 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:26:20.822985 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:26:20.822985 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application with Lock( Aug 09 16:26:20.822985 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:26:20.822985 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:26:20.822985 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:26:20.822985 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:26:20.823795 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:26:20.823795 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:26:20.823795 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:26:20.823795 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:26:20.823795 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 16:26:20.823795 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 16:26:20.823795 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 16:26:20.823795 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 16:26:20.823795 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 16:26:20.823795 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 16:26:20.823795 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 16:26:20.823795 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Aug 09 16:26:20.823795 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 80/159] 10.222.0.104 () {56 vars in 1119 bytes} [Tue Aug 9 16:26:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 16:26:20.832252 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22df1380-e4c5-4e42-98ae-42aa582f9a75 None None] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:20.975045 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:20.978950 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22df1380-e4c5-4e42-98ae-42aa582f9a75 None None] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:21.023681 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f8e7f3-42dc-40b0-97ec-d590594a6a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:21.024215 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f8e7f3-42dc-40b0-97ec-d590594a6a2d None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:21.024494 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f8e7f3-42dc-40b0-97ec-d590594a6a2d None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:21.024764 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f8e7f3-42dc-40b0-97ec-d590594a6a2d None admin] PATH_INFO: `/v3/roles` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:21.025429 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f8e7f3-42dc-40b0-97ec-d590594a6a2d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:26:21.025732 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f8e7f3-42dc-40b0-97ec-d590594a6a2d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:21.027136 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f8e7f3-42dc-40b0-97ec-d590594a6a2d None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:21.035673 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 80/160] 10.222.0.104 () {56 vars in 1116 bytes} [Tue Aug 9 16:26:20 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:26:21.041296 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3490a5-1cc7-436e-a1a0-cfc6b379b05e None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:21.072417 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05856ab-f305-4e77-ab66-f58982d54d74 None None] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:21.072753 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05856ab-f305-4e77-ab66-f58982d54d74 None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:21.073003 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05856ab-f305-4e77-ab66-f58982d54d74 None None] PATH_INFO: `/` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:21.074448 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 81/161] 10.222.0.104 () {54 vars in 932 bytes} [Tue Aug 9 16:26:21 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 09 16:26:21.092244 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554764d1-69d9-4bfb-86eb-2c92817b3f40 None None] REQUEST_METHOD: `POST` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:21.092561 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554764d1-69d9-4bfb-86eb-2c92817b3f40 None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:21.092806 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554764d1-69d9-4bfb-86eb-2c92817b3f40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:21.122484 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.auth.core [None req-554764d1-69d9-4bfb-86eb-2c92817b3f40 None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:26:21.123691 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.fernet_utils [None req-554764d1-69d9-4bfb-86eb-2c92817b3f40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:26:21.193296 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3490a5-1cc7-436e-a1a0-cfc6b379b05e None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:21.231205 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 82/162] 10.222.0.104 () {58 vars in 1029 bytes} [Tue Aug 9 16:26:21 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 16:26:21.265402 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8f4f70-f9b2-4840-b55f-aa32bb7d25f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:21.266068 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8f4f70-f9b2-4840-b55f-aa32bb7d25f4 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:21.266345 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8f4f70-f9b2-4840-b55f-aa32bb7d25f4 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:21.266621 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8f4f70-f9b2-4840-b55f-aa32bb7d25f4 None admin] PATH_INFO: `/v3/users/90e486c670fa4bac812f14eb300edcae` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:21.270596 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8f4f70-f9b2-4840-b55f-aa32bb7d25f4 None admin] RBAC: Authorizing `identity:get_user(user_id=90e486c670fa4bac812f14eb300edcae)` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:21.272047 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8f4f70-f9b2-4840-b55f-aa32bb7d25f4 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:21.273846 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 81/163] 10.222.0.104 () {56 vars in 1182 bytes} [Tue Aug 9 16:26:21 2022] GET /identity/v3/users/90e486c670fa4bac812f14eb300edcae => generated 276 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:26:21.279450 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554764d1-69d9-4bfb-86eb-2c92817b3f40 None None] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:21.299859 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8f4f70-f9b2-4840-b55f-aa32bb7d25f4 None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:21.378322 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:21.429976 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:21.464161 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554764d1-69d9-4bfb-86eb-2c92817b3f40 None None] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:21.500637 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8f4f70-f9b2-4840-b55f-aa32bb7d25f4 None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:21.533548 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57ee4dd-bc2e-44f1-8168-a8fd4ad63866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:21.534107 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57ee4dd-bc2e-44f1-8168-a8fd4ad63866 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:21.534387 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57ee4dd-bc2e-44f1-8168-a8fd4ad63866 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:21.534653 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57ee4dd-bc2e-44f1-8168-a8fd4ad63866 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:21.572263 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0079e9-56b9-49d8-84bb-0ac1ec576f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:21.572922 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0079e9-56b9-49d8-84bb-0ac1ec576f67 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:21.573200 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0079e9-56b9-49d8-84bb-0ac1ec576f67 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:21.573470 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0079e9-56b9-49d8-84bb-0ac1ec576f67 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:21.602945 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0079e9-56b9-49d8-84bb-0ac1ec576f67 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 16:26:21.609276 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application [None req-7c0079e9-56b9-49d8-84bb-0ac1ec576f67 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 16:26:21.609276 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:26:21.609276 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:26:21.609276 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:26:21.609276 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:26:21.609276 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:26:21.609276 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:26:21.609276 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:26:21.609276 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:26:21.609276 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:26:21.609276 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:26:21.609276 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:26:21.609276 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 16:26:21.609276 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 16:26:21.609276 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 16:26:21.609276 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 16:26:21.610193 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 16:26:21.610193 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 16:26:21.610193 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 16:26:21.610193 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 16:26:21.610193 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:26:21.610193 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:26:21.610193 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:26:21.610193 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:26:21.610193 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:26:21.610193 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:26:21.610193 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:26:21.610193 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application with Lock( Aug 09 16:26:21.610193 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:26:21.610193 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:26:21.610193 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:26:21.610193 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:26:21.611540 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:26:21.611540 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:26:21.611540 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:26:21.611540 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:26:21.611540 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 16:26:21.611540 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 16:26:21.611540 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 16:26:21.611540 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 16:26:21.611540 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 16:26:21.611540 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 16:26:21.611540 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 16:26:21.611540 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Aug 09 16:26:21.611540 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 82/164] 10.222.0.104 () {56 vars in 1101 bytes} [Tue Aug 9 16:26:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 16:26:21.612414 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26ced9b-5c2e-447a-ac76-3bdffd1b05f1 None None] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:21.612991 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26ced9b-5c2e-447a-ac76-3bdffd1b05f1 None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:21.612991 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26ced9b-5c2e-447a-ac76-3bdffd1b05f1 None None] PATH_INFO: `/` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:21.619799 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 83/165] 10.222.0.104 () {54 vars in 932 bytes} [Tue Aug 9 16:26:21 2022] GET /identity => generated 271 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:26:21.620593 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26ced9b-5c2e-447a-ac76-3bdffd1b05f1 None None] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:21.701621 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57ee4dd-bc2e-44f1-8168-a8fd4ad63866 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:21.703317 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57ee4dd-bc2e-44f1-8168-a8fd4ad63866 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:21.818383 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:21.833278 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26ced9b-5c2e-447a-ac76-3bdffd1b05f1 None None] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:21.870353 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:21.877515 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 83/166] 10.222.0.104 () {58 vars in 1287 bytes} [Tue Aug 9 16:26:21 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 599 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 16:26:21.878964 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3955ae54-c389-4967-b944-d3161562b1e4 None None] REQUEST_METHOD: `POST` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:21.879257 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3955ae54-c389-4967-b944-d3161562b1e4 None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:21.879539 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3955ae54-c389-4967-b944-d3161562b1e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:21.910642 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53564ac3-1218-42f9-810b-c9edaa2ce052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:21.911271 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53564ac3-1218-42f9-810b-c9edaa2ce052 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:21.911764 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53564ac3-1218-42f9-810b-c9edaa2ce052 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:21.912033 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53564ac3-1218-42f9-810b-c9edaa2ce052 None admin] PATH_INFO: `/v3/roles` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:21.912700 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53564ac3-1218-42f9-810b-c9edaa2ce052 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:26:21.913000 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53564ac3-1218-42f9-810b-c9edaa2ce052 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:21.914429 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53564ac3-1218-42f9-810b-c9edaa2ce052 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:21.914890 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.auth.core [None req-3955ae54-c389-4967-b944-d3161562b1e4 None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:26:21.916099 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.fernet_utils [None req-3955ae54-c389-4967-b944-d3161562b1e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:26:21.927743 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 84/167] 10.222.0.104 () {56 vars in 1104 bytes} [Tue Aug 9 16:26:21 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:26:21.928571 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53564ac3-1218-42f9-810b-c9edaa2ce052 None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:22.021044 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 84/168] 10.222.0.104 () {58 vars in 1029 bytes} [Tue Aug 9 16:26:21 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 16:26:22.021924 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3955ae54-c389-4967-b944-d3161562b1e4 None None] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:22.106125 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53564ac3-1218-42f9-810b-c9edaa2ce052 None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:22.149575 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851da9a7-1d24-4df0-807b-ebb6f42ce61d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:22.150239 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851da9a7-1d24-4df0-807b-ebb6f42ce61d None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:22.150510 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851da9a7-1d24-4df0-807b-ebb6f42ce61d None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:22.150779 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851da9a7-1d24-4df0-807b-ebb6f42ce61d None admin] PATH_INFO: `/v3/projects/8e08184221014bc3bf771cdbe24c6720` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:22.154087 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851da9a7-1d24-4df0-807b-ebb6f42ce61d None admin] RBAC: Authorizing `identity:get_project(project_id=8e08184221014bc3bf771cdbe24c6720)` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:22.155526 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851da9a7-1d24-4df0-807b-ebb6f42ce61d None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:22.157244 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 85/169] 10.222.0.104 () {56 vars in 1191 bytes} [Tue Aug 9 16:26:21 2022] GET /identity/v3/projects/8e08184221014bc3bf771cdbe24c6720 => generated 299 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:26:22.163820 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851da9a7-1d24-4df0-807b-ebb6f42ce61d None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:22.229967 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:22.247484 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3955ae54-c389-4967-b944-d3161562b1e4 None None] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:22.288497 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:22.346719 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaba5e44-2096-41b4-a65c-887f72e13dfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:22.347373 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaba5e44-2096-41b4-a65c-887f72e13dfd None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:22.347650 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaba5e44-2096-41b4-a65c-887f72e13dfd None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:22.347922 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaba5e44-2096-41b4-a65c-887f72e13dfd None admin] PATH_INFO: `/v3/users/cd0c59114b4e47af86cbee7e2a704cf6` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:22.349065 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaba5e44-2096-41b4-a65c-887f72e13dfd None admin] RBAC: Authorizing `identity:get_user(user_id=cd0c59114b4e47af86cbee7e2a704cf6)` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:22.350802 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaba5e44-2096-41b4-a65c-887f72e13dfd None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:22.352445 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 85/170] 10.222.0.104 () {56 vars in 1182 bytes} [Tue Aug 9 16:26:22 2022] GET /identity/v3/users/cd0c59114b4e47af86cbee7e2a704cf6 => generated 248 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:26:22.353213 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaba5e44-2096-41b4-a65c-887f72e13dfd None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:22.377955 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851da9a7-1d24-4df0-807b-ebb6f42ce61d None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:22.456815 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2759238a-e4ec-46eb-a569-4e8c8a3f4d64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:22.457512 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2759238a-e4ec-46eb-a569-4e8c8a3f4d64 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:22.458086 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2759238a-e4ec-46eb-a569-4e8c8a3f4d64 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:22.458425 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2759238a-e4ec-46eb-a569-4e8c8a3f4d64 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:22.488292 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2759238a-e4ec-46eb-a569-4e8c8a3f4d64 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 16:26:22.493051 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application [None req-2759238a-e4ec-46eb-a569-4e8c8a3f4d64 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 09 16:26:22.493051 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:26:22.493051 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:26:22.493051 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:26:22.493051 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:26:22.493051 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:26:22.493051 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:26:22.493051 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:26:22.493051 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:26:22.493051 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:26:22.493051 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:26:22.493051 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:26:22.493051 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 16:26:22.493051 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 16:26:22.493051 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 16:26:22.493051 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 16:26:22.493893 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 16:26:22.493893 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 16:26:22.493893 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 16:26:22.493893 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 16:26:22.493893 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:26:22.493893 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:26:22.493893 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:26:22.493893 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:26:22.493893 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:26:22.493893 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:26:22.493893 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:26:22.493893 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application with Lock( Aug 09 16:26:22.493893 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:26:22.493893 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:26:22.493893 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:26:22.493893 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:26:22.494709 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:26:22.494709 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:26:22.494709 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:26:22.494709 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:26:22.494709 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 16:26:22.494709 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 16:26:22.494709 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 16:26:22.494709 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 16:26:22.494709 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 16:26:22.494709 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 16:26:22.494709 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 09 16:26:22.494709 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Aug 09 16:26:22.500686 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 86/171] 10.222.0.104 () {56 vars in 1104 bytes} [Tue Aug 9 16:26:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 343 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 16:26:22.503874 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2759238a-e4ec-46eb-a569-4e8c8a3f4d64 None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:22.603200 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaba5e44-2096-41b4-a65c-887f72e13dfd None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:22.680224 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3083a3f8-6c3f-4a23-89fb-e703c05863d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:22.680848 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3083a3f8-6c3f-4a23-89fb-e703c05863d8 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:22.681134 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3083a3f8-6c3f-4a23-89fb-e703c05863d8 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:22.681374 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3083a3f8-6c3f-4a23-89fb-e703c05863d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:22.682246 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3083a3f8-6c3f-4a23-89fb-e703c05863d8 None admin] RBAC: Adding query filter params (role.id=8a954d5b81f74df1985780d968ff3073, scope.project.id=8e08184221014bc3bf771cdbe24c6720, user.id=90e486c670fa4bac812f14eb300edcae) {{(pid=87275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:26:22.682561 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3083a3f8-6c3f-4a23-89fb-e703c05863d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:22.684199 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3083a3f8-6c3f-4a23-89fb-e703c05863d8 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:22.698726 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 86/172] 10.222.0.104 () {56 vars in 1379 bytes} [Tue Aug 9 16:26:22 2022] GET /identity/v3/role_assignments?user.id=90e486c670fa4bac812f14eb300edcae&scope.project.id=8e08184221014bc3bf771cdbe24c6720&role.id=8a954d5b81f74df1985780d968ff3073 => generated 610 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:26:22.699642 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3083a3f8-6c3f-4a23-89fb-e703c05863d8 None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:22.731731 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:22.786266 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:22.794137 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2759238a-e4ec-46eb-a569-4e8c8a3f4d64 None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:22.871017 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3083a3f8-6c3f-4a23-89fb-e703c05863d8 None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:22.920321 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d458aba-6c16-4396-8412-4af1f9c7f164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:22.920939 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d458aba-6c16-4396-8412-4af1f9c7f164 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:22.921399 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d458aba-6c16-4396-8412-4af1f9c7f164 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:22.921670 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d458aba-6c16-4396-8412-4af1f9c7f164 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:22.938825 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed688fb-41cf-4e59-bd82-4ff67a887317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:22.939409 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed688fb-41cf-4e59-bd82-4ff67a887317 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:22.939816 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed688fb-41cf-4e59-bd82-4ff67a887317 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:22.940094 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed688fb-41cf-4e59-bd82-4ff67a887317 None admin] PATH_INFO: `/v3/roles` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:22.940776 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed688fb-41cf-4e59-bd82-4ff67a887317 None admin] RBAC: Adding query filter params (name=member) {{(pid=87275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:26:22.941080 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed688fb-41cf-4e59-bd82-4ff67a887317 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:22.942510 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed688fb-41cf-4e59-bd82-4ff67a887317 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:22.951992 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 87/173] 10.222.0.104 () {56 vars in 1106 bytes} [Tue Aug 9 16:26:22 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:26:22.958261 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed688fb-41cf-4e59-bd82-4ff67a887317 None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:23.092582 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d458aba-6c16-4396-8412-4af1f9c7f164 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:23.095014 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed688fb-41cf-4e59-bd82-4ff67a887317 None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:23.098367 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d458aba-6c16-4396-8412-4af1f9c7f164 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:23.110271 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:23.146050 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33e0261-7c42-46c9-9eb4-0699d5146096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:23.146754 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33e0261-7c42-46c9-9eb4-0699d5146096 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:23.147032 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33e0261-7c42-46c9-9eb4-0699d5146096 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:23.147303 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33e0261-7c42-46c9-9eb4-0699d5146096 None admin] PATH_INFO: `/v3/users/90e486c670fa4bac812f14eb300edcae` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:23.149827 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33e0261-7c42-46c9-9eb4-0699d5146096 None admin] RBAC: Authorizing `identity:get_user(user_id=90e486c670fa4bac812f14eb300edcae)` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:23.151392 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33e0261-7c42-46c9-9eb4-0699d5146096 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:23.153168 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 88/174] 10.222.0.104 () {56 vars in 1182 bytes} [Tue Aug 9 16:26:22 2022] GET /identity/v3/users/90e486c670fa4bac812f14eb300edcae => generated 276 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 16:26:23.154220 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9c54aa-0e9a-4120-a016-8084d2d8857a None None] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:23.154497 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9c54aa-0e9a-4120-a016-8084d2d8857a None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:23.154767 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9c54aa-0e9a-4120-a016-8084d2d8857a None None] PATH_INFO: `/` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:23.155964 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 89/175] 10.222.0.104 () {54 vars in 932 bytes} [Tue Aug 9 16:26:23 2022] GET /identity => generated 271 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:26:23.161546 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6e6729-da05-4f6b-88ab-05d5f47d58d9 None None] REQUEST_METHOD: `POST` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:23.161832 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6e6729-da05-4f6b-88ab-05d5f47d58d9 None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:23.162136 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6e6729-da05-4f6b-88ab-05d5f47d58d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:23.181226 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.auth.core [None req-db6e6729-da05-4f6b-88ab-05d5f47d58d9 None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:26:23.182474 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.fernet_utils [None req-db6e6729-da05-4f6b-88ab-05d5f47d58d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:26:23.200388 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:23.219482 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 87/176] 10.222.0.104 () {58 vars in 1287 bytes} [Tue Aug 9 16:26:22 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 718 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 16:26:23.220372 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d458aba-6c16-4396-8412-4af1f9c7f164 None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:23.255842 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 90/177] 10.222.0.104 () {58 vars in 1029 bytes} [Tue Aug 9 16:26:23 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 16:26:23.257116 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ba8f11-8165-43c6-803f-ced6a7f9bc16 None None] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:23.257405 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ba8f11-8165-43c6-803f-ced6a7f9bc16 None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:23.257681 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ba8f11-8165-43c6-803f-ced6a7f9bc16 None None] PATH_INFO: `/` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:23.259213 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 91/178] 10.222.0.104 () {54 vars in 932 bytes} [Tue Aug 9 16:26:23 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:26:23.260311 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020d5273-5490-4568-8318-3811f36c50e6 None None] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:23.260581 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020d5273-5490-4568-8318-3811f36c50e6 None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:23.260860 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020d5273-5490-4568-8318-3811f36c50e6 None None] PATH_INFO: `/` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:23.262264 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 92/179] 10.222.0.104 () {54 vars in 932 bytes} [Tue Aug 9 16:26:23 2022] GET /identity => generated 271 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:26:23.262838 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020d5273-5490-4568-8318-3811f36c50e6 None None] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:23.327925 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d458aba-6c16-4396-8412-4af1f9c7f164 None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:23.362795 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3c02c6-eab7-47ba-bd44-f6dcd932b8b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:23.363396 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3c02c6-eab7-47ba-bd44-f6dcd932b8b7 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:23.363672 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3c02c6-eab7-47ba-bd44-f6dcd932b8b7 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:23.363942 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3c02c6-eab7-47ba-bd44-f6dcd932b8b7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:23.368278 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020d5273-5490-4568-8318-3811f36c50e6 None None] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:23.370522 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:23.403568 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bb11b6-ffee-45e5-9444-c53f9920e40b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:23.404192 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bb11b6-ffee-45e5-9444-c53f9920e40b None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:23.404467 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bb11b6-ffee-45e5-9444-c53f9920e40b None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:23.404734 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bb11b6-ffee-45e5-9444-c53f9920e40b None admin] PATH_INFO: `/v3/projects/8e08184221014bc3bf771cdbe24c6720` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:23.405926 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bb11b6-ffee-45e5-9444-c53f9920e40b None admin] RBAC: Authorizing `identity:get_project(project_id=8e08184221014bc3bf771cdbe24c6720)` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:23.407364 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bb11b6-ffee-45e5-9444-c53f9920e40b None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:23.409485 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 93/180] 10.222.0.104 () {56 vars in 1191 bytes} [Tue Aug 9 16:26:23 2022] GET /identity/v3/projects/8e08184221014bc3bf771cdbe24c6720 => generated 299 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:26:23.410663 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d92325b-4498-4f0f-ac1b-aa88ed78f98e None None] REQUEST_METHOD: `POST` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:23.410944 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d92325b-4498-4f0f-ac1b-aa88ed78f98e None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:23.411211 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d92325b-4498-4f0f-ac1b-aa88ed78f98e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:23.425154 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:23.429469 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.auth.core [None req-3d92325b-4498-4f0f-ac1b-aa88ed78f98e None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:26:23.430772 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.fernet_utils [None req-3d92325b-4498-4f0f-ac1b-aa88ed78f98e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:26:23.440007 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3c02c6-eab7-47ba-bd44-f6dcd932b8b7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:23.441506 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3c02c6-eab7-47ba-bd44-f6dcd932b8b7 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:23.495068 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 94/181] 10.222.0.104 () {58 vars in 1029 bytes} [Tue Aug 9 16:26:23 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 16:26:23.496217 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3e1c8b-d1b7-49a1-830a-966c7edc52be None None] REQUEST_METHOD: `POST` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:23.496501 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3e1c8b-d1b7-49a1-830a-966c7edc52be None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:23.496775 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3e1c8b-d1b7-49a1-830a-966c7edc52be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:23.524270 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.auth.core [None req-8d3e1c8b-d1b7-49a1-830a-966c7edc52be None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:26:23.525453 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.fernet_utils [None req-8d3e1c8b-d1b7-49a1-830a-966c7edc52be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:26:23.546404 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 88/182] 10.222.0.104 () {58 vars in 1287 bytes} [Tue Aug 9 16:26:23 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 16:26:23.547238 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3c02c6-eab7-47ba-bd44-f6dcd932b8b7 None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:23.592742 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 95/183] 10.222.0.104 () {58 vars in 1029 bytes} [Tue Aug 9 16:26:23 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 16:26:23.594145 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46870835-564c-4e6a-b461-cfc0666eec6f None None] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:23.594434 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46870835-564c-4e6a-b461-cfc0666eec6f None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:23.594710 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46870835-564c-4e6a-b461-cfc0666eec6f None None] PATH_INFO: `/` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:23.597947 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 96/184] 10.222.0.104 () {54 vars in 932 bytes} [Tue Aug 9 16:26:23 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:26:23.597947 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46870835-564c-4e6a-b461-cfc0666eec6f None None] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:23.636891 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:23.637479 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:23.654577 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3c02c6-eab7-47ba-bd44-f6dcd932b8b7 None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:23.688847 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff90c66-12ed-439e-bfaf-5868f6a6ba90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:23.689470 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff90c66-12ed-439e-bfaf-5868f6a6ba90 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:23.689744 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff90c66-12ed-439e-bfaf-5868f6a6ba90 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:23.690044 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff90c66-12ed-439e-bfaf-5868f6a6ba90 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:23.699826 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff90c66-12ed-439e-bfaf-5868f6a6ba90 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 16:26:23.705111 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application [None req-aff90c66-12ed-439e-bfaf-5868f6a6ba90 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 16:26:23.705111 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:26:23.705111 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:26:23.705111 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:26:23.705111 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:26:23.705111 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:26:23.705111 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:26:23.705111 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:26:23.705111 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:26:23.705111 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:26:23.705111 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:26:23.705111 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:26:23.705111 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 16:26:23.705111 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 16:26:23.705111 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 16:26:23.705111 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 16:26:23.706136 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 16:26:23.706136 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 16:26:23.706136 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 16:26:23.706136 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 16:26:23.706136 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:26:23.706136 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:26:23.706136 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:26:23.706136 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:26:23.706136 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:26:23.706136 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:26:23.706136 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:26:23.706136 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application with Lock( Aug 09 16:26:23.706136 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:26:23.706136 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:26:23.706136 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:26:23.706136 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:26:23.707157 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:26:23.707157 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:26:23.707157 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:26:23.707157 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:26:23.707157 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 16:26:23.707157 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 16:26:23.707157 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 16:26:23.707157 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 16:26:23.707157 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 16:26:23.707157 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 16:26:23.707157 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 16:26:23.707157 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Aug 09 16:26:23.707157 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 89/185] 10.222.0.104 () {56 vars in 1119 bytes} [Tue Aug 9 16:26:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 16:26:23.707157 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff90c66-12ed-439e-bfaf-5868f6a6ba90 None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:23.716320 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46870835-564c-4e6a-b461-cfc0666eec6f None None] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:23.750251 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7ab143-7171-44e4-952e-1978efe90e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:23.750779 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7ab143-7171-44e4-952e-1978efe90e5e None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:23.751392 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7ab143-7171-44e4-952e-1978efe90e5e None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:23.751676 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7ab143-7171-44e4-952e-1978efe90e5e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:23.752553 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7ab143-7171-44e4-952e-1978efe90e5e None admin] RBAC: Adding query filter params (role.id=c0143e35c1344a39a931bbb6bcd5acdc, scope.project.id=8e08184221014bc3bf771cdbe24c6720, user.id=cd0c59114b4e47af86cbee7e2a704cf6) {{(pid=87275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:26:23.752862 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7ab143-7171-44e4-952e-1978efe90e5e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:23.754339 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7ab143-7171-44e4-952e-1978efe90e5e None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:23.773945 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 97/186] 10.222.0.104 () {56 vars in 1379 bytes} [Tue Aug 9 16:26:23 2022] GET /identity/v3/role_assignments?user.id=cd0c59114b4e47af86cbee7e2a704cf6&scope.project.id=8e08184221014bc3bf771cdbe24c6720&role.id=c0143e35c1344a39a931bbb6bcd5acdc => generated 610 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:26:23.773945 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7ab143-7171-44e4-952e-1978efe90e5e None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:23.815447 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff90c66-12ed-439e-bfaf-5868f6a6ba90 None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:23.858273 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7fc5e2-3feb-4c60-baa5-898b8877c0c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:23.859580 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7fc5e2-3feb-4c60-baa5-898b8877c0c3 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:23.859580 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7fc5e2-3feb-4c60-baa5-898b8877c0c3 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:23.859580 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7fc5e2-3feb-4c60-baa5-898b8877c0c3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:23.871526 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7fc5e2-3feb-4c60-baa5-898b8877c0c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 16:26:23.876880 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application [None req-0e7fc5e2-3feb-4c60-baa5-898b8877c0c3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 09 16:26:23.876880 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:26:23.876880 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:26:23.876880 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:26:23.876880 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:26:23.876880 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:26:23.876880 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:26:23.876880 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:26:23.876880 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:26:23.876880 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:26:23.876880 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:26:23.876880 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:26:23.876880 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 16:26:23.876880 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 16:26:23.876880 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 16:26:23.876880 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 16:26:23.877820 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 16:26:23.877820 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 16:26:23.877820 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 16:26:23.877820 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 16:26:23.877820 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:26:23.877820 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:26:23.877820 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:26:23.877820 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:26:23.877820 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:26:23.877820 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:26:23.877820 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:26:23.877820 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application with Lock( Aug 09 16:26:23.877820 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:26:23.877820 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:26:23.877820 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:26:23.877820 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:26:23.878633 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:26:23.878633 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:26:23.878633 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:26:23.878633 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:26:23.878633 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 16:26:23.878633 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 16:26:23.878633 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 16:26:23.878633 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 16:26:23.878633 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 16:26:23.878633 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 16:26:23.878633 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 09 16:26:23.878633 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Aug 09 16:26:23.878633 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 90/187] 10.222.0.104 () {56 vars in 1104 bytes} [Tue Aug 9 16:26:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 16:26:23.880123 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525d6b35-68e2-408c-aa85-6539019181da None None] REQUEST_METHOD: `POST` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:23.880123 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525d6b35-68e2-408c-aa85-6539019181da None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:23.880123 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525d6b35-68e2-408c-aa85-6539019181da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:23.893351 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:23.896014 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:23.900399 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.auth.core [None req-525d6b35-68e2-408c-aa85-6539019181da None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:26:23.901619 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.fernet_utils [None req-525d6b35-68e2-408c-aa85-6539019181da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:26:23.906455 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7ab143-7171-44e4-952e-1978efe90e5e None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:23.944948 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe621ce-8754-4a4a-93de-5e1067de6d1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:23.945595 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe621ce-8754-4a4a-93de-5e1067de6d1d None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:23.945873 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe621ce-8754-4a4a-93de-5e1067de6d1d None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:23.946172 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe621ce-8754-4a4a-93de-5e1067de6d1d None admin] PATH_INFO: `/v3/projects/2966cedde9c44486bcb32a457df8d6c5` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:23.947693 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe621ce-8754-4a4a-93de-5e1067de6d1d None admin] RBAC: Authorizing `identity:get_project(project_id=2966cedde9c44486bcb32a457df8d6c5)` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:23.949148 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe621ce-8754-4a4a-93de-5e1067de6d1d None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:23.951161 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 98/188] 10.222.0.104 () {56 vars in 1191 bytes} [Tue Aug 9 16:26:23 2022] GET /identity/v3/projects/2966cedde9c44486bcb32a457df8d6c5 => generated 313 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:26:23.952097 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe621ce-8754-4a4a-93de-5e1067de6d1d None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:23.997936 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 91/189] 10.222.0.104 () {58 vars in 1029 bytes} [Tue Aug 9 16:26:23 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 16:26:23.997936 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525d6b35-68e2-408c-aa85-6539019181da None None] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:24.078127 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe621ce-8754-4a4a-93de-5e1067de6d1d None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:24.106245 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525d6b35-68e2-408c-aa85-6539019181da None None] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:24.110228 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a9d163-fc11-475d-95f0-72c62894c7ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:24.110883 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a9d163-fc11-475d-95f0-72c62894c7ab None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:24.111158 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a9d163-fc11-475d-95f0-72c62894c7ab None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:24.111430 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a9d163-fc11-475d-95f0-72c62894c7ab None admin] PATH_INFO: `/v3/domains/default` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:24.112528 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a9d163-fc11-475d-95f0-72c62894c7ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:24.114007 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a9d163-fc11-475d-95f0-72c62894c7ab None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:24.115569 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 99/190] 10.222.0.104 () {56 vars in 1113 bytes} [Tue Aug 9 16:26:23 2022] GET /identity/v3/domains/default => generated 200 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:26:24.118823 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a9d163-fc11-475d-95f0-72c62894c7ab None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:24.140394 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9199324f-ab08-4ce1-839a-21f2b7c94695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:24.140997 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9199324f-ab08-4ce1-839a-21f2b7c94695 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:24.141275 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9199324f-ab08-4ce1-839a-21f2b7c94695 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:24.141545 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9199324f-ab08-4ce1-839a-21f2b7c94695 None admin] PATH_INFO: `/v3/roles` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:24.142795 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9199324f-ab08-4ce1-839a-21f2b7c94695 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:26:24.143117 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9199324f-ab08-4ce1-839a-21f2b7c94695 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:24.144459 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9199324f-ab08-4ce1-839a-21f2b7c94695 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:24.146578 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:24.149547 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:24.153881 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 92/191] 10.222.0.104 () {56 vars in 1116 bytes} [Tue Aug 9 16:26:23 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:26:24.154762 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9199324f-ab08-4ce1-839a-21f2b7c94695 None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:24.217674 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a9d163-fc11-475d-95f0-72c62894c7ab None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:24.250940 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80787cc9-24ee-479e-9fdb-524fbc0915fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:24.252087 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80787cc9-24ee-479e-9fdb-524fbc0915fe None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:24.252369 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80787cc9-24ee-479e-9fdb-524fbc0915fe None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:24.252640 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80787cc9-24ee-479e-9fdb-524fbc0915fe None admin] PATH_INFO: `/v3/roles` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:24.252738 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9199324f-ab08-4ce1-839a-21f2b7c94695 None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:24.253292 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80787cc9-24ee-479e-9fdb-524fbc0915fe None admin] RBAC: Adding query filter params (name=reader) {{(pid=87275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:26:24.253592 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80787cc9-24ee-479e-9fdb-524fbc0915fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:24.255000 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80787cc9-24ee-479e-9fdb-524fbc0915fe None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:24.262916 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 100/192] 10.222.0.104 () {56 vars in 1106 bytes} [Tue Aug 9 16:26:24 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:26:24.263704 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80787cc9-24ee-479e-9fdb-524fbc0915fe None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:24.286076 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e5ff2b-2d99-4015-9e04-d2954a78c628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:24.287103 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e5ff2b-2d99-4015-9e04-d2954a78c628 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:24.287644 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e5ff2b-2d99-4015-9e04-d2954a78c628 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:24.287984 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e5ff2b-2d99-4015-9e04-d2954a78c628 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:24.288875 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e5ff2b-2d99-4015-9e04-d2954a78c628 None admin] RBAC: Adding query filter params (role.id=044ca4f80141492b9c128ada543865e8, scope.project.id=2966cedde9c44486bcb32a457df8d6c5, user.id=90e486c670fa4bac812f14eb300edcae) {{(pid=87276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:26:24.289183 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e5ff2b-2d99-4015-9e04-d2954a78c628 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:24.290717 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e5ff2b-2d99-4015-9e04-d2954a78c628 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:24.296540 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 93/193] 10.222.0.104 () {56 vars in 1379 bytes} [Tue Aug 9 16:26:24 2022] GET /identity/v3/role_assignments?user.id=90e486c670fa4bac812f14eb300edcae&scope.project.id=2966cedde9c44486bcb32a457df8d6c5&role.id=044ca4f80141492b9c128ada543865e8 => generated 610 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:26:24.297198 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e5ff2b-2d99-4015-9e04-d2954a78c628 None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:24.371383 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:24.379958 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:24.389315 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80787cc9-24ee-479e-9fdb-524fbc0915fe None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:24.423668 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e5ff2b-2d99-4015-9e04-d2954a78c628 None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:24.428117 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a03629e-1cee-4c5d-9bea-391ba75f90c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:24.428766 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a03629e-1cee-4c5d-9bea-391ba75f90c5 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:24.429044 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a03629e-1cee-4c5d-9bea-391ba75f90c5 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:24.429313 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a03629e-1cee-4c5d-9bea-391ba75f90c5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:24.441868 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a03629e-1cee-4c5d-9bea-391ba75f90c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 16:26:24.447236 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application [None req-1a03629e-1cee-4c5d-9bea-391ba75f90c5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 16:26:24.447236 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:26:24.447236 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:26:24.447236 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:26:24.447236 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:26:24.447236 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:26:24.447236 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:26:24.447236 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:26:24.447236 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:26:24.447236 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:26:24.447236 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:26:24.447236 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:26:24.447236 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 16:26:24.447236 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 16:26:24.447236 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 16:26:24.447236 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 16:26:24.448163 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 16:26:24.448163 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 16:26:24.448163 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 16:26:24.448163 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 16:26:24.448163 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:26:24.448163 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:26:24.448163 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:26:24.448163 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:26:24.448163 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:26:24.448163 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:26:24.448163 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:26:24.448163 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application with Lock( Aug 09 16:26:24.448163 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:26:24.448163 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:26:24.448163 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:26:24.448163 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:26:24.448947 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:26:24.448947 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:26:24.448947 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:26:24.448947 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:26:24.448947 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 16:26:24.448947 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 16:26:24.448947 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 16:26:24.448947 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 16:26:24.448947 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 16:26:24.448947 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 16:26:24.448947 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 16:26:24.448947 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Aug 09 16:26:24.448947 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 101/194] 10.222.0.104 () {56 vars in 1101 bytes} [Tue Aug 9 16:26:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 16:26:24.449595 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a03629e-1cee-4c5d-9bea-391ba75f90c5 None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:24.467351 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b49d2a-3889-47ed-92dd-85e4e00aedf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:24.468180 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b49d2a-3889-47ed-92dd-85e4e00aedf3 None admin] REQUEST_METHOD: `POST` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:24.468293 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b49d2a-3889-47ed-92dd-85e4e00aedf3 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:24.468506 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b49d2a-3889-47ed-92dd-85e4e00aedf3 None admin] PATH_INFO: `/v3/users` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:24.469159 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b49d2a-3889-47ed-92dd-85e4e00aedf3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:24.470654 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b49d2a-3889-47ed-92dd-85e4e00aedf3 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:24.497875 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 94/195] 10.222.0.104 () {60 vars in 1137 bytes} [Tue Aug 9 16:26:24 2022] POST /identity/v3/users => generated 298 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 16:26:24.502993 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b49d2a-3889-47ed-92dd-85e4e00aedf3 None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:24.590581 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a03629e-1cee-4c5d-9bea-391ba75f90c5 None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:24.633187 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c061dcc-9331-4f0f-91bc-55436437289f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:24.633746 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c061dcc-9331-4f0f-91bc-55436437289f None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:24.634057 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c061dcc-9331-4f0f-91bc-55436437289f None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:24.634359 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c061dcc-9331-4f0f-91bc-55436437289f None admin] PATH_INFO: `/v3/users/f8a35e8835eb4c6fbc9a8436f39972a0` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:24.647503 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b49d2a-3889-47ed-92dd-85e4e00aedf3 None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:24.649634 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c061dcc-9331-4f0f-91bc-55436437289f None admin] RBAC: Authorizing `identity:get_user(user_id=f8a35e8835eb4c6fbc9a8436f39972a0)` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:24.651229 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c061dcc-9331-4f0f-91bc-55436437289f None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:24.653714 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 102/196] 10.222.0.104 () {56 vars in 1182 bytes} [Tue Aug 9 16:26:24 2022] GET /identity/v3/users/f8a35e8835eb4c6fbc9a8436f39972a0 => generated 284 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:26:24.654835 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c061dcc-9331-4f0f-91bc-55436437289f None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:24.670828 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:24.674836 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:24.693209 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0510d162-963c-4888-b5bf-96b4e3c1be61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:24.693864 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0510d162-963c-4888-b5bf-96b4e3c1be61 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:24.694217 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0510d162-963c-4888-b5bf-96b4e3c1be61 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:24.695381 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0510d162-963c-4888-b5bf-96b4e3c1be61 None admin] PATH_INFO: `/v3/users/76f408bb21ec48ebba9692c37ae07061` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:24.696036 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0510d162-963c-4888-b5bf-96b4e3c1be61 None admin] RBAC: Authorizing `identity:get_user(user_id=76f408bb21ec48ebba9692c37ae07061)` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:24.698169 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0510d162-963c-4888-b5bf-96b4e3c1be61 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:24.699935 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 95/197] 10.222.0.104 () {56 vars in 1182 bytes} [Tue Aug 9 16:26:24 2022] GET /identity/v3/users/76f408bb21ec48ebba9692c37ae07061 => generated 290 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:26:24.700716 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0510d162-963c-4888-b5bf-96b4e3c1be61 None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:24.789798 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c061dcc-9331-4f0f-91bc-55436437289f None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:24.834408 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0510d162-963c-4888-b5bf-96b4e3c1be61 None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:24.839014 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8225b7bf-f62e-490a-9a29-800c319d90a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:24.839637 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8225b7bf-f62e-490a-9a29-800c319d90a4 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:24.839919 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8225b7bf-f62e-490a-9a29-800c319d90a4 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:24.840194 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8225b7bf-f62e-490a-9a29-800c319d90a4 None admin] PATH_INFO: `/v3/roles` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:24.840861 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8225b7bf-f62e-490a-9a29-800c319d90a4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:26:24.841248 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8225b7bf-f62e-490a-9a29-800c319d90a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:24.843099 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8225b7bf-f62e-490a-9a29-800c319d90a4 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:24.852895 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 103/198] 10.222.0.104 () {56 vars in 1104 bytes} [Tue Aug 9 16:26:24 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:26:24.853741 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8225b7bf-f62e-490a-9a29-800c319d90a4 None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:24.880548 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2368a8cc-30fe-4654-bee5-5a8e2c54c074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:24.881160 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2368a8cc-30fe-4654-bee5-5a8e2c54c074 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:24.881434 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2368a8cc-30fe-4654-bee5-5a8e2c54c074 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:24.881700 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2368a8cc-30fe-4654-bee5-5a8e2c54c074 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:24.948651 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:24.964798 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:24.979813 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8225b7bf-f62e-490a-9a29-800c319d90a4 None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:24.984074 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2368a8cc-30fe-4654-bee5-5a8e2c54c074 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:24.985609 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2368a8cc-30fe-4654-bee5-5a8e2c54c074 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:25.015349 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b00830-db73-4b1c-b34d-09e3549b1f41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:25.016242 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b00830-db73-4b1c-b34d-09e3549b1f41 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:25.016709 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b00830-db73-4b1c-b34d-09e3549b1f41 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:25.017694 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b00830-db73-4b1c-b34d-09e3549b1f41 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:25.093219 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b00830-db73-4b1c-b34d-09e3549b1f41 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:25.095660 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b00830-db73-4b1c-b34d-09e3549b1f41 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:25.116210 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 96/199] 10.222.0.104 () {58 vars in 1287 bytes} [Tue Aug 9 16:26:24 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 16:26:25.116210 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2368a8cc-30fe-4654-bee5-5a8e2c54c074 None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:25.210277 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:25.215761 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:25.225579 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 104/200] 10.222.0.104 () {58 vars in 1287 bytes} [Tue Aug 9 16:26:24 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 16:26:25.225579 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b00830-db73-4b1c-b34d-09e3549b1f41 None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:25.232639 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2368a8cc-30fe-4654-bee5-5a8e2c54c074 None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:25.277873 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845bc191-2c3c-4efe-8115-8b6193606ec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:25.279166 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845bc191-2c3c-4efe-8115-8b6193606ec1 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:25.279890 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845bc191-2c3c-4efe-8115-8b6193606ec1 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:25.280856 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845bc191-2c3c-4efe-8115-8b6193606ec1 None admin] PATH_INFO: `/v3/users/f8a35e8835eb4c6fbc9a8436f39972a0` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:25.283033 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845bc191-2c3c-4efe-8115-8b6193606ec1 None admin] RBAC: Authorizing `identity:get_user(user_id=f8a35e8835eb4c6fbc9a8436f39972a0)` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:25.285597 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845bc191-2c3c-4efe-8115-8b6193606ec1 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:25.288846 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 97/201] 10.222.0.104 () {56 vars in 1182 bytes} [Tue Aug 9 16:26:25 2022] GET /identity/v3/users/f8a35e8835eb4c6fbc9a8436f39972a0 => generated 284 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:26:25.289937 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845bc191-2c3c-4efe-8115-8b6193606ec1 None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:25.335578 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b00830-db73-4b1c-b34d-09e3549b1f41 None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:25.377923 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ed9c16-9e49-478e-a395-ae75588b9e7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:25.379508 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ed9c16-9e49-478e-a395-ae75588b9e7b None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:25.379964 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ed9c16-9e49-478e-a395-ae75588b9e7b None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:25.380648 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ed9c16-9e49-478e-a395-ae75588b9e7b None admin] PATH_INFO: `/v3/projects/01f42016635a4e7ab655700eadbb1d93` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:25.382261 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ed9c16-9e49-478e-a395-ae75588b9e7b None admin] RBAC: Authorizing `identity:get_project(project_id=01f42016635a4e7ab655700eadbb1d93)` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:25.384871 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ed9c16-9e49-478e-a395-ae75588b9e7b None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:25.387149 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 105/202] 10.222.0.104 () {56 vars in 1191 bytes} [Tue Aug 9 16:26:25 2022] GET /identity/v3/projects/01f42016635a4e7ab655700eadbb1d93 => generated 303 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:26:25.388771 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ed9c16-9e49-478e-a395-ae75588b9e7b None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:25.414878 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845bc191-2c3c-4efe-8115-8b6193606ec1 None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:25.451481 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:25.453177 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf7fc33-3b37-48e1-8953-e28db9206e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:25.455099 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf7fc33-3b37-48e1-8953-e28db9206e40 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:25.455378 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf7fc33-3b37-48e1-8953-e28db9206e40 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:25.455648 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf7fc33-3b37-48e1-8953-e28db9206e40 None admin] PATH_INFO: `/v3/projects/8e08184221014bc3bf771cdbe24c6720` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:25.457267 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf7fc33-3b37-48e1-8953-e28db9206e40 None admin] RBAC: Authorizing `identity:get_project(project_id=8e08184221014bc3bf771cdbe24c6720)` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:25.459485 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf7fc33-3b37-48e1-8953-e28db9206e40 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:25.461616 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 98/203] 10.222.0.104 () {56 vars in 1191 bytes} [Tue Aug 9 16:26:25 2022] GET /identity/v3/projects/8e08184221014bc3bf771cdbe24c6720 => generated 299 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:26:25.462732 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf7fc33-3b37-48e1-8953-e28db9206e40 None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:25.496654 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:25.523547 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ed9c16-9e49-478e-a395-ae75588b9e7b None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:25.559185 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7871d7d9-e3a8-4a13-8130-1bbbd8599cd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:25.559795 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7871d7d9-e3a8-4a13-8130-1bbbd8599cd2 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:25.560074 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7871d7d9-e3a8-4a13-8130-1bbbd8599cd2 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:25.560614 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7871d7d9-e3a8-4a13-8130-1bbbd8599cd2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:25.583148 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf7fc33-3b37-48e1-8953-e28db9206e40 None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:25.621149 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52abb972-97eb-4d78-9531-2b7ee5133000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:25.622259 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52abb972-97eb-4d78-9531-2b7ee5133000 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:25.622745 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52abb972-97eb-4d78-9531-2b7ee5133000 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:25.623213 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52abb972-97eb-4d78-9531-2b7ee5133000 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:25.624364 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52abb972-97eb-4d78-9531-2b7ee5133000 None admin] RBAC: Adding query filter params (role.id=8a954d5b81f74df1985780d968ff3073, scope.project.id=01f42016635a4e7ab655700eadbb1d93, user.id=f8a35e8835eb4c6fbc9a8436f39972a0) {{(pid=87276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:26:25.624862 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52abb972-97eb-4d78-9531-2b7ee5133000 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:25.627103 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52abb972-97eb-4d78-9531-2b7ee5133000 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:25.632034 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7871d7d9-e3a8-4a13-8130-1bbbd8599cd2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:25.633522 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7871d7d9-e3a8-4a13-8130-1bbbd8599cd2 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:25.634022 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 99/204] 10.222.0.104 () {56 vars in 1379 bytes} [Tue Aug 9 16:26:25 2022] GET /identity/v3/role_assignments?user.id=f8a35e8835eb4c6fbc9a8436f39972a0&scope.project.id=01f42016635a4e7ab655700eadbb1d93&role.id=8a954d5b81f74df1985780d968ff3073 => generated 260 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:26:25.635089 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52abb972-97eb-4d78-9531-2b7ee5133000 None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:25.689063 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:25.753679 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:25.775582 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52abb972-97eb-4d78-9531-2b7ee5133000 None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:25.784973 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 106/205] 10.222.0.104 () {58 vars in 1287 bytes} [Tue Aug 9 16:26:25 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 16:26:25.791024 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7871d7d9-e3a8-4a13-8130-1bbbd8599cd2 None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:25.814403 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a779803-4cac-4772-b1a5-00a2413ca0b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:25.815018 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a779803-4cac-4772-b1a5-00a2413ca0b3 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:25.815294 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a779803-4cac-4772-b1a5-00a2413ca0b3 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:25.815564 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a779803-4cac-4772-b1a5-00a2413ca0b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:25.816293 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a779803-4cac-4772-b1a5-00a2413ca0b3 None admin] RBAC: Adding query filter params (role.id=92a80348b6cb4bb38f2a6a9f5facb705, scope.project.id=8e08184221014bc3bf771cdbe24c6720, user.id=76f408bb21ec48ebba9692c37ae07061) {{(pid=87276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:26:25.816602 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a779803-4cac-4772-b1a5-00a2413ca0b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:25.818248 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a779803-4cac-4772-b1a5-00a2413ca0b3 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:25.825644 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 100/206] 10.222.0.104 () {56 vars in 1379 bytes} [Tue Aug 9 16:26:25 2022] GET /identity/v3/role_assignments?user.id=76f408bb21ec48ebba9692c37ae07061&scope.project.id=8e08184221014bc3bf771cdbe24c6720&role.id=92a80348b6cb4bb38f2a6a9f5facb705 => generated 610 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:26:25.956571 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7871d7d9-e3a8-4a13-8130-1bbbd8599cd2 None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:26.000909 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521282a2-81eb-4671-9eaf-45278b70d57d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:26.002157 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521282a2-81eb-4671-9eaf-45278b70d57d None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:26.002436 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521282a2-81eb-4671-9eaf-45278b70d57d None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:26.002771 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521282a2-81eb-4671-9eaf-45278b70d57d None admin] PATH_INFO: `/v3/projects/01f42016635a4e7ab655700eadbb1d93` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:26.004026 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521282a2-81eb-4671-9eaf-45278b70d57d None admin] RBAC: Authorizing `identity:get_project(project_id=01f42016635a4e7ab655700eadbb1d93)` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:26.005443 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521282a2-81eb-4671-9eaf-45278b70d57d None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:26.007358 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 107/207] 10.222.0.104 () {56 vars in 1191 bytes} [Tue Aug 9 16:26:25 2022] GET /identity/v3/projects/01f42016635a4e7ab655700eadbb1d93 => generated 303 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:26:26.013461 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a779803-4cac-4772-b1a5-00a2413ca0b3 None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:26.122642 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a779803-4cac-4772-b1a5-00a2413ca0b3 None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:26.159932 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13987e99-265f-43e7-a1f1-791e09dc7893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:26.160545 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13987e99-265f-43e7-a1f1-791e09dc7893 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:26.160822 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13987e99-265f-43e7-a1f1-791e09dc7893 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:26.161092 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13987e99-265f-43e7-a1f1-791e09dc7893 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:26.161811 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13987e99-265f-43e7-a1f1-791e09dc7893 None admin] RBAC: Adding query filter params (role.id=c0143e35c1344a39a931bbb6bcd5acdc, scope.project.id=01f42016635a4e7ab655700eadbb1d93, user.id=f8a35e8835eb4c6fbc9a8436f39972a0) {{(pid=87276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:26:26.162147 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13987e99-265f-43e7-a1f1-791e09dc7893 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:26.163636 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13987e99-265f-43e7-a1f1-791e09dc7893 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:26.169582 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 101/208] 10.222.0.104 () {56 vars in 1379 bytes} [Tue Aug 9 16:26:26 2022] GET /identity/v3/role_assignments?user.id=f8a35e8835eb4c6fbc9a8436f39972a0&scope.project.id=01f42016635a4e7ab655700eadbb1d93&role.id=c0143e35c1344a39a931bbb6bcd5acdc => generated 260 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:26:27.090021 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363555ed-fa7b-4330-92cf-c00b9f77c2f2 None None] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:27.090021 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363555ed-fa7b-4330-92cf-c00b9f77c2f2 None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:27.090021 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363555ed-fa7b-4330-92cf-c00b9f77c2f2 None None] PATH_INFO: `/` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:27.091540 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 108/209] 10.222.0.104 () {54 vars in 932 bytes} [Tue Aug 9 16:26:27 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:26:27.097661 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d3ea41-5b4b-427e-8b88-f32a6546679f None None] REQUEST_METHOD: `POST` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:27.098503 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d3ea41-5b4b-427e-8b88-f32a6546679f None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:27.098989 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d3ea41-5b4b-427e-8b88-f32a6546679f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:27.118210 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.auth.core [None req-d1d3ea41-5b4b-427e-8b88-f32a6546679f None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:26:27.119717 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.fernet_utils [None req-d1d3ea41-5b4b-427e-8b88-f32a6546679f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:26:27.129710 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:27.195556 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 102/210] 10.222.0.104 () {58 vars in 1029 bytes} [Tue Aug 9 16:26:27 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 16:26:27.220685 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363555ed-fa7b-4330-92cf-c00b9f77c2f2 None None] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:27.234112 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:27.278551 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb11b42-9064-4444-94a4-770c82ef4479 None None] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:27.278899 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb11b42-9064-4444-94a4-770c82ef4479 None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:27.279104 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb11b42-9064-4444-94a4-770c82ef4479 None None] PATH_INFO: `/` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:27.280679 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 103/211] 10.222.0.104 () {54 vars in 932 bytes} [Tue Aug 9 16:26:27 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:26:27.286229 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f18304-8b32-4d4f-a94e-24055942521f None None] REQUEST_METHOD: `POST` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:27.286621 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f18304-8b32-4d4f-a94e-24055942521f None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:27.287095 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f18304-8b32-4d4f-a94e-24055942521f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:27.308081 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.auth.core [None req-26f18304-8b32-4d4f-a94e-24055942521f None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:26:27.309364 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.fernet_utils [None req-26f18304-8b32-4d4f-a94e-24055942521f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:26:27.330206 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363555ed-fa7b-4330-92cf-c00b9f77c2f2 None None] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:27.368354 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8cc924-a183-4736-b520-c1200eab1bea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:27.369080 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8cc924-a183-4736-b520-c1200eab1bea None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:27.369360 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8cc924-a183-4736-b520-c1200eab1bea None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:27.369624 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8cc924-a183-4736-b520-c1200eab1bea None admin] PATH_INFO: `/v3/domains/default` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:27.370820 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8cc924-a183-4736-b520-c1200eab1bea None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:27.372259 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8cc924-a183-4736-b520-c1200eab1bea None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:27.374225 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 109/212] 10.222.0.104 () {56 vars in 1113 bytes} [Tue Aug 9 16:26:27 2022] GET /identity/v3/domains/default => generated 200 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:26:27.380119 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8cc924-a183-4736-b520-c1200eab1bea None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:27.394018 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 104/213] 10.222.0.104 () {58 vars in 1029 bytes} [Tue Aug 9 16:26:27 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 16:26:27.417721 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f18304-8b32-4d4f-a94e-24055942521f None None] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:27.470127 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:27.494679 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8cc924-a183-4736-b520-c1200eab1bea None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:27.495292 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:27.522745 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f18304-8b32-4d4f-a94e-24055942521f None None] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:27.533362 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548f987a-4267-4d14-8bdd-d9690d86bf46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:27.534002 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548f987a-4267-4d14-8bdd-d9690d86bf46 None admin] REQUEST_METHOD: `POST` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:27.534373 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548f987a-4267-4d14-8bdd-d9690d86bf46 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:27.534654 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548f987a-4267-4d14-8bdd-d9690d86bf46 None admin] PATH_INFO: `/v3/users` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:27.535291 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548f987a-4267-4d14-8bdd-d9690d86bf46 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:27.536737 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548f987a-4267-4d14-8bdd-d9690d86bf46 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:27.561950 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15d4109-9469-4771-8e9f-b9824ed7230e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:27.562737 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15d4109-9469-4771-8e9f-b9824ed7230e None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:27.563128 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15d4109-9469-4771-8e9f-b9824ed7230e None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:27.564019 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15d4109-9469-4771-8e9f-b9824ed7230e None admin] PATH_INFO: `/v3/roles/member` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:27.569348 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 110/214] 10.222.0.104 () {60 vars in 1137 bytes} [Tue Aug 9 16:26:27 2022] POST /identity/v3/users => generated 298 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 16:26:27.581789 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15d4109-9469-4771-8e9f-b9824ed7230e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 16:26:27.588750 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application [None req-a15d4109-9469-4771-8e9f-b9824ed7230e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 09 16:26:27.588750 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:26:27.588750 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:26:27.588750 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:26:27.588750 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:26:27.588750 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:26:27.588750 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:26:27.588750 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:26:27.588750 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:26:27.588750 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:26:27.588750 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:26:27.588750 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:26:27.588750 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 16:26:27.588750 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 16:26:27.588750 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 16:26:27.588750 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 16:26:27.590975 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 16:26:27.590975 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 16:26:27.590975 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 16:26:27.590975 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 16:26:27.590975 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:26:27.590975 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:26:27.590975 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:26:27.590975 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:26:27.590975 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:26:27.590975 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:26:27.590975 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:26:27.590975 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application with Lock( Aug 09 16:26:27.590975 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:26:27.590975 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:26:27.590975 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:26:27.590975 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:26:27.593151 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:26:27.593151 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:26:27.593151 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:26:27.593151 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:26:27.593151 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 16:26:27.593151 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 16:26:27.593151 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 16:26:27.593151 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 16:26:27.593151 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 16:26:27.593151 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 16:26:27.593151 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 09 16:26:27.593151 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Aug 09 16:26:27.593151 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 105/215] 10.222.0.104 () {56 vars in 1104 bytes} [Tue Aug 9 16:26:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 16:26:27.599296 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548f987a-4267-4d14-8bdd-d9690d86bf46 None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:27.722311 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548f987a-4267-4d14-8bdd-d9690d86bf46 None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:27.760800 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d657af4-a416-4dff-a013-d1481ac4022c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:27.761409 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d657af4-a416-4dff-a013-d1481ac4022c None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:27.761686 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d657af4-a416-4dff-a013-d1481ac4022c None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:27.761953 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d657af4-a416-4dff-a013-d1481ac4022c None admin] PATH_INFO: `/v3/roles` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:27.762639 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d657af4-a416-4dff-a013-d1481ac4022c None admin] RBAC: Adding query filter params (name=member) {{(pid=87275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:26:27.762946 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d657af4-a416-4dff-a013-d1481ac4022c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:27.764424 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d657af4-a416-4dff-a013-d1481ac4022c None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:27.766000 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:27.897144 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 111/216] 10.222.0.104 () {56 vars in 1106 bytes} [Tue Aug 9 16:26:27 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:26:27.902638 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15d4109-9469-4771-8e9f-b9824ed7230e None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:28.018787 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15d4109-9469-4771-8e9f-b9824ed7230e None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:28.062720 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7fe324-f59a-4e2e-ac73-7cde98e0a6c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:28.063404 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7fe324-f59a-4e2e-ac73-7cde98e0a6c5 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:28.063684 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7fe324-f59a-4e2e-ac73-7cde98e0a6c5 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:28.063958 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7fe324-f59a-4e2e-ac73-7cde98e0a6c5 None admin] PATH_INFO: `/v3/users/b3c8063bcbcb4876a6de609419db8379` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:28.066154 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:28.080216 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7fe324-f59a-4e2e-ac73-7cde98e0a6c5 None admin] RBAC: Authorizing `identity:get_user(user_id=b3c8063bcbcb4876a6de609419db8379)` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:28.082145 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7fe324-f59a-4e2e-ac73-7cde98e0a6c5 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:28.084198 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 106/217] 10.222.0.104 () {56 vars in 1182 bytes} [Tue Aug 9 16:26:27 2022] GET /identity/v3/users/b3c8063bcbcb4876a6de609419db8379 => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:26:28.089694 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d657af4-a416-4dff-a013-d1481ac4022c None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:28.203776 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d657af4-a416-4dff-a013-d1481ac4022c None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:28.246108 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e7cad7-a429-4ce8-afa4-66303e7e01bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:28.246729 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e7cad7-a429-4ce8-afa4-66303e7e01bf None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:28.247010 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e7cad7-a429-4ce8-afa4-66303e7e01bf None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:28.247287 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e7cad7-a429-4ce8-afa4-66303e7e01bf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:28.333266 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:28.338335 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be64e0b-6b06-49f1-83a3-b65b5a111b23 None None] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:28.339004 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be64e0b-6b06-49f1-83a3-b65b5a111b23 None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:28.339004 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be64e0b-6b06-49f1-83a3-b65b5a111b23 None None] PATH_INFO: `/` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:28.340264 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 107/218] 10.222.0.104 () {54 vars in 932 bytes} [Tue Aug 9 16:26:28 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 09 16:26:28.344566 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e7cad7-a429-4ce8-afa4-66303e7e01bf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:28.346059 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4921b4-f60c-480a-8475-1e4baeada4e2 None None] REQUEST_METHOD: `POST` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:28.346348 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4921b4-f60c-480a-8475-1e4baeada4e2 None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:28.346626 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4921b4-f60c-480a-8475-1e4baeada4e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:28.347067 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e7cad7-a429-4ce8-afa4-66303e7e01bf None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:28.368163 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.auth.core [None req-6d4921b4-f60c-480a-8475-1e4baeada4e2 None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:26:28.369540 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.fernet_utils [None req-6d4921b4-f60c-480a-8475-1e4baeada4e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:26:28.452164 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 108/219] 10.222.0.104 () {58 vars in 1029 bytes} [Tue Aug 9 16:26:28 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 16:26:28.477499 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4921b4-f60c-480a-8475-1e4baeada4e2 None None] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:28.561308 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 112/220] 10.222.0.104 () {58 vars in 1287 bytes} [Tue Aug 9 16:26:28 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 16:26:28.562632 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761ac15f-6bbf-49e3-b7b2-7a2333a0c718 None None] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:28.562917 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761ac15f-6bbf-49e3-b7b2-7a2333a0c718 None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:28.563708 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761ac15f-6bbf-49e3-b7b2-7a2333a0c718 None None] PATH_INFO: `/` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:28.565180 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 113/221] 10.222.0.104 () {54 vars in 932 bytes} [Tue Aug 9 16:26:28 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:26:28.570685 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449d2fa2-d16d-439b-a1a1-07ffd39992d5 None None] REQUEST_METHOD: `POST` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:28.571128 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449d2fa2-d16d-439b-a1a1-07ffd39992d5 None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:28.571414 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449d2fa2-d16d-439b-a1a1-07ffd39992d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:28.591104 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.auth.core [None req-449d2fa2-d16d-439b-a1a1-07ffd39992d5 None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:26:28.592502 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.fernet_utils [None req-449d2fa2-d16d-439b-a1a1-07ffd39992d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:26:28.595453 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4921b4-f60c-480a-8475-1e4baeada4e2 None None] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:28.628090 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:28.643255 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcddad7-2600-4030-b169-ca62ddaf31a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:28.643937 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcddad7-2600-4030-b169-ca62ddaf31a4 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:28.644468 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcddad7-2600-4030-b169-ca62ddaf31a4 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:28.644746 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcddad7-2600-4030-b169-ca62ddaf31a4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:28.659962 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcddad7-2600-4030-b169-ca62ddaf31a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 16:26:28.665495 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application [None req-4fcddad7-2600-4030-b169-ca62ddaf31a4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 16:26:28.665495 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:26:28.665495 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:26:28.665495 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:26:28.665495 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:26:28.665495 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:26:28.665495 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:26:28.665495 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:26:28.665495 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:26:28.665495 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:26:28.665495 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:26:28.665495 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:26:28.665495 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 16:26:28.665495 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 16:26:28.665495 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 16:26:28.665495 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 16:26:28.667517 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 16:26:28.667517 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 16:26:28.667517 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 16:26:28.667517 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 16:26:28.667517 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:26:28.667517 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:26:28.667517 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:26:28.667517 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:26:28.667517 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:26:28.667517 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:26:28.667517 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:26:28.667517 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application with Lock( Aug 09 16:26:28.667517 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:26:28.667517 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:26:28.667517 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:26:28.667517 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:26:28.669629 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:26:28.669629 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:26:28.669629 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:26:28.669629 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:26:28.669629 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 16:26:28.669629 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 16:26:28.669629 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 16:26:28.669629 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 16:26:28.669629 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 16:26:28.669629 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 16:26:28.669629 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 16:26:28.669629 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Aug 09 16:26:28.671133 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 114/223] 10.222.0.104 () {58 vars in 1029 bytes} [Tue Aug 9 16:26:28 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 16:26:28.671133 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449d2fa2-d16d-439b-a1a1-07ffd39992d5 None None] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:28.678150 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 109/223] 10.222.0.104 () {56 vars in 1119 bytes} [Tue Aug 9 16:26:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 16:26:28.682794 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcddad7-2600-4030-b169-ca62ddaf31a4 None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:28.713870 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:28.789467 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcddad7-2600-4030-b169-ca62ddaf31a4 None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:28.802252 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449d2fa2-d16d-439b-a1a1-07ffd39992d5 None None] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:28.827078 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d2ccba-41da-42dd-81d3-65158b2bf951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:28.827909 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d2ccba-41da-42dd-81d3-65158b2bf951 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:28.828351 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d2ccba-41da-42dd-81d3-65158b2bf951 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:28.828761 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d2ccba-41da-42dd-81d3-65158b2bf951 None admin] PATH_INFO: `/v3/roles` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:28.829720 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d2ccba-41da-42dd-81d3-65158b2bf951 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:26:28.830188 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d2ccba-41da-42dd-81d3-65158b2bf951 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:28.831692 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d2ccba-41da-42dd-81d3-65158b2bf951 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:28.844818 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f649d1-5d0f-4378-af99-d7b1765a4814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:28.845382 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f649d1-5d0f-4378-af99-d7b1765a4814 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:28.845660 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f649d1-5d0f-4378-af99-d7b1765a4814 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:28.845951 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f649d1-5d0f-4378-af99-d7b1765a4814 None admin] PATH_INFO: `/v3/projects/01f42016635a4e7ab655700eadbb1d93` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:28.847104 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f649d1-5d0f-4378-af99-d7b1765a4814 None admin] RBAC: Authorizing `identity:get_project(project_id=01f42016635a4e7ab655700eadbb1d93)` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:28.848823 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f649d1-5d0f-4378-af99-d7b1765a4814 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:28.850930 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 115/225] 10.222.0.104 () {56 vars in 1191 bytes} [Tue Aug 9 16:26:28 2022] GET /identity/v3/projects/01f42016635a4e7ab655700eadbb1d93 => generated 303 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:26:28.851766 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 110/225] 10.222.0.104 () {56 vars in 1116 bytes} [Tue Aug 9 16:26:28 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 16:26:28.852244 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f649d1-5d0f-4378-af99-d7b1765a4814 None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:28.852715 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d2ccba-41da-42dd-81d3-65158b2bf951 None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:28.902073 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:28.961253 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d2ccba-41da-42dd-81d3-65158b2bf951 None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:28.963228 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:28.970553 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f649d1-5d0f-4378-af99-d7b1765a4814 None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:29.000397 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e281c94-5de2-4ae6-935a-6329a5dfb59a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:29.001578 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e281c94-5de2-4ae6-935a-6329a5dfb59a None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:29.001879 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e281c94-5de2-4ae6-935a-6329a5dfb59a None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:29.002203 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e281c94-5de2-4ae6-935a-6329a5dfb59a None admin] PATH_INFO: `/v3/users/f8a35e8835eb4c6fbc9a8436f39972a0` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:29.004030 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e281c94-5de2-4ae6-935a-6329a5dfb59a None admin] RBAC: Authorizing `identity:get_user(user_id=f8a35e8835eb4c6fbc9a8436f39972a0)` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:29.005568 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e281c94-5de2-4ae6-935a-6329a5dfb59a None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:29.007333 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 111/226] 10.222.0.104 () {56 vars in 1182 bytes} [Tue Aug 9 16:26:28 2022] GET /identity/v3/users/f8a35e8835eb4c6fbc9a8436f39972a0 => generated 284 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:26:29.007924 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e281c94-5de2-4ae6-935a-6329a5dfb59a None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:29.008695 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba73c6e-94f4-4768-82b0-9683ce636e3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:29.009617 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba73c6e-94f4-4768-82b0-9683ce636e3a None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:29.010123 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba73c6e-94f4-4768-82b0-9683ce636e3a None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:29.010708 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba73c6e-94f4-4768-82b0-9683ce636e3a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:29.023186 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba73c6e-94f4-4768-82b0-9683ce636e3a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 16:26:29.029210 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application [None req-eba73c6e-94f4-4768-82b0-9683ce636e3a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 16:26:29.029210 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:26:29.029210 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:26:29.029210 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:26:29.029210 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:26:29.029210 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:26:29.029210 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:26:29.029210 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:26:29.029210 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:26:29.029210 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:26:29.029210 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:26:29.029210 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:26:29.029210 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 16:26:29.029210 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 16:26:29.029210 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 16:26:29.029210 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 16:26:29.030112 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 16:26:29.030112 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 16:26:29.030112 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 16:26:29.030112 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 16:26:29.030112 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:26:29.030112 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:26:29.030112 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:26:29.030112 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:26:29.030112 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:26:29.030112 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:26:29.030112 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:26:29.030112 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application with Lock( Aug 09 16:26:29.030112 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:26:29.030112 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:26:29.030112 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:26:29.030112 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:26:29.030898 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:26:29.030898 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:26:29.030898 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:26:29.030898 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:26:29.030898 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 16:26:29.030898 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 16:26:29.030898 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 16:26:29.030898 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 16:26:29.030898 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 16:26:29.030898 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 16:26:29.030898 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 16:26:29.030898 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Aug 09 16:26:29.033555 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 116/227] 10.222.0.104 () {56 vars in 1101 bytes} [Tue Aug 9 16:26:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 16:26:29.034525 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba73c6e-94f4-4768-82b0-9683ce636e3a None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:29.137408 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e281c94-5de2-4ae6-935a-6329a5dfb59a None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:29.145807 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba73c6e-94f4-4768-82b0-9683ce636e3a None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:29.162271 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:29.187566 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93cfe32-4155-43d1-a899-f0ce9a32b2a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:29.188690 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93cfe32-4155-43d1-a899-f0ce9a32b2a5 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:29.188972 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93cfe32-4155-43d1-a899-f0ce9a32b2a5 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:29.189245 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93cfe32-4155-43d1-a899-f0ce9a32b2a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:29.190004 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93cfe32-4155-43d1-a899-f0ce9a32b2a5 None admin] RBAC: Adding query filter params (role.id=044ca4f80141492b9c128ada543865e8, scope.project.id=01f42016635a4e7ab655700eadbb1d93, user.id=b3c8063bcbcb4876a6de609419db8379) {{(pid=87276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:26:29.190317 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93cfe32-4155-43d1-a899-f0ce9a32b2a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:29.190997 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e964c1a9-7b0f-462c-8e1a-4f201b95c8a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:29.191753 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93cfe32-4155-43d1-a899-f0ce9a32b2a5 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:29.192328 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e964c1a9-7b0f-462c-8e1a-4f201b95c8a1 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:29.192830 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e964c1a9-7b0f-462c-8e1a-4f201b95c8a1 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:29.193286 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e964c1a9-7b0f-462c-8e1a-4f201b95c8a1 None admin] PATH_INFO: `/v3/projects/01f42016635a4e7ab655700eadbb1d93` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:29.195356 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e964c1a9-7b0f-462c-8e1a-4f201b95c8a1 None admin] RBAC: Authorizing `identity:get_project(project_id=01f42016635a4e7ab655700eadbb1d93)` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:29.197372 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e964c1a9-7b0f-462c-8e1a-4f201b95c8a1 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:29.197563 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 112/228] 10.222.0.104 () {56 vars in 1379 bytes} [Tue Aug 9 16:26:29 2022] GET /identity/v3/role_assignments?user.id=b3c8063bcbcb4876a6de609419db8379&scope.project.id=01f42016635a4e7ab655700eadbb1d93&role.id=044ca4f80141492b9c128ada543865e8 => generated 260 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:26:29.204451 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 117/229] 10.222.0.104 () {56 vars in 1191 bytes} [Tue Aug 9 16:26:29 2022] GET /identity/v3/projects/01f42016635a4e7ab655700eadbb1d93 => generated 303 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:26:29.205074 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93cfe32-4155-43d1-a899-f0ce9a32b2a5 None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:29.206526 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e964c1a9-7b0f-462c-8e1a-4f201b95c8a1 None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:29.267200 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:29.408645 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93cfe32-4155-43d1-a899-f0ce9a32b2a5 None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:29.416395 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e964c1a9-7b0f-462c-8e1a-4f201b95c8a1 None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:29.452988 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc02e481-e586-47f5-a2ba-011117d372bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:29.453688 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc02e481-e586-47f5-a2ba-011117d372bf None admin] REQUEST_METHOD: `PUT` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:29.454531 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc02e481-e586-47f5-a2ba-011117d372bf None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:29.454809 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc02e481-e586-47f5-a2ba-011117d372bf None admin] PATH_INFO: `/v3/projects/01f42016635a4e7ab655700eadbb1d93/users/f8a35e8835eb4c6fbc9a8436f39972a0/roles/8a954d5b81f74df1985780d968ff3073` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:29.457563 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc02e481-e586-47f5-a2ba-011117d372bf None admin] RBAC: Authorizing `identity:create_grant(project_id=01f42016635a4e7ab655700eadbb1d93, user_id=f8a35e8835eb4c6fbc9a8436f39972a0, role_id=8a954d5b81f74df1985780d968ff3073)` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:29.459218 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc02e481-e586-47f5-a2ba-011117d372bf None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:29.475086 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 118/230] 10.222.0.104 () {58 vars in 1444 bytes} [Tue Aug 9 16:26:29 2022] PUT /identity/v3/projects/01f42016635a4e7ab655700eadbb1d93/users/f8a35e8835eb4c6fbc9a8436f39972a0/roles/8a954d5b81f74df1985780d968ff3073 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 16:26:29.511825 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ba422e-1153-4972-a95d-8a1339445489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:29.512463 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ba422e-1153-4972-a95d-8a1339445489 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:29.512746 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ba422e-1153-4972-a95d-8a1339445489 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:29.513018 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ba422e-1153-4972-a95d-8a1339445489 None admin] PATH_INFO: `/v3/roles` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:29.513697 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ba422e-1153-4972-a95d-8a1339445489 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:26:29.514029 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ba422e-1153-4972-a95d-8a1339445489 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:29.515471 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ba422e-1153-4972-a95d-8a1339445489 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:29.536728 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 113/231] 10.222.0.104 () {56 vars in 1104 bytes} [Tue Aug 9 16:26:29 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:26:29.542685 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc02e481-e586-47f5-a2ba-011117d372bf None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:29.682838 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:29.706148 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc02e481-e586-47f5-a2ba-011117d372bf None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:29.745172 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d972f3-2701-4268-8fe0-115867788250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:29.746213 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d972f3-2701-4268-8fe0-115867788250 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:29.746684 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d972f3-2701-4268-8fe0-115867788250 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:29.747160 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d972f3-2701-4268-8fe0-115867788250 None admin] PATH_INFO: `/v3/users/f8a35e8835eb4c6fbc9a8436f39972a0` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:29.748509 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d972f3-2701-4268-8fe0-115867788250 None admin] RBAC: Authorizing `identity:get_user(user_id=f8a35e8835eb4c6fbc9a8436f39972a0)` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:29.750162 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d972f3-2701-4268-8fe0-115867788250 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:29.752776 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 119/232] 10.222.0.104 () {56 vars in 1182 bytes} [Tue Aug 9 16:26:29 2022] GET /identity/v3/users/f8a35e8835eb4c6fbc9a8436f39972a0 => generated 284 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:26:29.759457 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ba422e-1153-4972-a95d-8a1339445489 None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:29.832281 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:29.909386 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ba422e-1153-4972-a95d-8a1339445489 None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:29.944677 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113139a3-c704-47c2-9bb0-fe3f34846114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:29.945237 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113139a3-c704-47c2-9bb0-fe3f34846114 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:29.945517 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113139a3-c704-47c2-9bb0-fe3f34846114 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:29.945793 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113139a3-c704-47c2-9bb0-fe3f34846114 None admin] PATH_INFO: `/v3/projects/01f42016635a4e7ab655700eadbb1d93` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:29.946967 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113139a3-c704-47c2-9bb0-fe3f34846114 None admin] RBAC: Authorizing `identity:get_project(project_id=01f42016635a4e7ab655700eadbb1d93)` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:29.948423 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113139a3-c704-47c2-9bb0-fe3f34846114 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:29.954034 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 114/233] 10.222.0.104 () {56 vars in 1191 bytes} [Tue Aug 9 16:26:29 2022] GET /identity/v3/projects/01f42016635a4e7ab655700eadbb1d93 => generated 303 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:26:29.956224 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d972f3-2701-4268-8fe0-115867788250 None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:30.085843 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d972f3-2701-4268-8fe0-115867788250 None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:30.122734 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a91a65-62f0-45e3-97db-dd05fdb1c325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:30.123401 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a91a65-62f0-45e3-97db-dd05fdb1c325 None admin] REQUEST_METHOD: `PUT` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:30.123761 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a91a65-62f0-45e3-97db-dd05fdb1c325 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:30.124032 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a91a65-62f0-45e3-97db-dd05fdb1c325 None admin] PATH_INFO: `/v3/projects/01f42016635a4e7ab655700eadbb1d93/users/f8a35e8835eb4c6fbc9a8436f39972a0/roles/c0143e35c1344a39a931bbb6bcd5acdc` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:30.125973 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a91a65-62f0-45e3-97db-dd05fdb1c325 None admin] RBAC: Authorizing `identity:create_grant(project_id=01f42016635a4e7ab655700eadbb1d93, user_id=f8a35e8835eb4c6fbc9a8436f39972a0, role_id=c0143e35c1344a39a931bbb6bcd5acdc)` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:30.127523 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a91a65-62f0-45e3-97db-dd05fdb1c325 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:30.142171 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 120/234] 10.222.0.104 () {58 vars in 1444 bytes} [Tue Aug 9 16:26:29 2022] PUT /identity/v3/projects/01f42016635a4e7ab655700eadbb1d93/users/f8a35e8835eb4c6fbc9a8436f39972a0/roles/c0143e35c1344a39a931bbb6bcd5acdc => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 16:26:30.538081 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375ef921-2804-4393-affd-9dffcec9e662 None None] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:30.538594 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375ef921-2804-4393-affd-9dffcec9e662 None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:30.538594 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375ef921-2804-4393-affd-9dffcec9e662 None None] PATH_INFO: `/` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:30.540201 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 115/235] 10.222.0.104 () {54 vars in 932 bytes} [Tue Aug 9 16:26:30 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:26:30.546538 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ecc3b4-ca60-48e1-91ad-7637e0abfb96 None None] REQUEST_METHOD: `POST` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:30.547006 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ecc3b4-ca60-48e1-91ad-7637e0abfb96 None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:30.547084 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ecc3b4-ca60-48e1-91ad-7637e0abfb96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:30.567677 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.auth.core [None req-53ecc3b4-ca60-48e1-91ad-7637e0abfb96 None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:26:30.568848 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.fernet_utils [None req-53ecc3b4-ca60-48e1-91ad-7637e0abfb96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:26:30.571907 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:30.646440 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 121/236] 10.222.0.104 () {58 vars in 1029 bytes} [Tue Aug 9 16:26:30 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 09 16:26:30.674336 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375ef921-2804-4393-affd-9dffcec9e662 None None] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:30.726339 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a35d4c3-5a26-4bd2-9b6c-55113dc34ab1 None None] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:30.726977 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a35d4c3-5a26-4bd2-9b6c-55113dc34ab1 None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:30.727409 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a35d4c3-5a26-4bd2-9b6c-55113dc34ab1 None None] PATH_INFO: `/` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:30.729162 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 122/237] 10.222.0.104 () {54 vars in 932 bytes} [Tue Aug 9 16:26:30 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 09 16:26:30.739733 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf30bd7-2be4-4095-8799-6d83fae3fdc9 None None] REQUEST_METHOD: `POST` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:30.740014 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf30bd7-2be4-4095-8799-6d83fae3fdc9 None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:30.740282 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf30bd7-2be4-4095-8799-6d83fae3fdc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:30.770593 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.auth.core [None req-6bf30bd7-2be4-4095-8799-6d83fae3fdc9 None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:26:30.771542 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.fernet_utils [None req-6bf30bd7-2be4-4095-8799-6d83fae3fdc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:26:30.785271 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375ef921-2804-4393-affd-9dffcec9e662 None None] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:30.795803 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:30.854077 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e71ae8b-4eef-4a59-9c24-5c2a380ee07b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:30.854962 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e71ae8b-4eef-4a59-9c24-5c2a380ee07b None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:30.855342 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e71ae8b-4eef-4a59-9c24-5c2a380ee07b None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:30.855760 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e71ae8b-4eef-4a59-9c24-5c2a380ee07b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:30.875726 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e71ae8b-4eef-4a59-9c24-5c2a380ee07b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 16:26:30.884058 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application [None req-1e71ae8b-4eef-4a59-9c24-5c2a380ee07b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 09 16:26:30.884058 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:26:30.884058 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:26:30.884058 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:26:30.884058 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:26:30.884058 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:26:30.884058 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:26:30.884058 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:26:30.884058 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:26:30.884058 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:26:30.884058 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:26:30.884058 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:26:30.884058 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 16:26:30.884058 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 16:26:30.884058 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 16:26:30.884058 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 16:26:30.884925 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 16:26:30.884925 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 16:26:30.884925 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 16:26:30.884925 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 16:26:30.884925 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:26:30.884925 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:26:30.884925 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:26:30.884925 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:26:30.884925 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:26:30.884925 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:26:30.884925 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:26:30.884925 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application with Lock( Aug 09 16:26:30.884925 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:26:30.884925 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:26:30.884925 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:26:30.884925 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:26:30.885693 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:26:30.885693 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:26:30.885693 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:26:30.885693 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:26:30.885693 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 16:26:30.885693 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 16:26:30.885693 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 16:26:30.885693 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 16:26:30.885693 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 16:26:30.885693 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 16:26:30.885693 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 09 16:26:30.885693 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Aug 09 16:26:30.886834 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 116/238] 10.222.0.104 () {56 vars in 1104 bytes} [Tue Aug 9 16:26:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 16:26:30.891918 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e71ae8b-4eef-4a59-9c24-5c2a380ee07b None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:30.909563 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 123/239] 10.222.0.104 () {58 vars in 1029 bytes} [Tue Aug 9 16:26:30 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 16:26:30.936206 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf30bd7-2be4-4095-8799-6d83fae3fdc9 None None] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:31.041015 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:31.078257 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf30bd7-2be4-4095-8799-6d83fae3fdc9 None None] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:31.104108 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e71ae8b-4eef-4a59-9c24-5c2a380ee07b None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:31.122346 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66b05de-5fe5-41b8-a60e-af995347d3ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:31.122986 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66b05de-5fe5-41b8-a60e-af995347d3ec None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:31.123258 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66b05de-5fe5-41b8-a60e-af995347d3ec None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:31.123624 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66b05de-5fe5-41b8-a60e-af995347d3ec None admin] PATH_INFO: `/v3/domains/default` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:31.124899 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66b05de-5fe5-41b8-a60e-af995347d3ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:31.126434 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66b05de-5fe5-41b8-a60e-af995347d3ec None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:31.128318 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 124/240] 10.222.0.104 () {56 vars in 1113 bytes} [Tue Aug 9 16:26:30 2022] GET /identity/v3/domains/default => generated 200 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 16:26:31.134804 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66b05de-5fe5-41b8-a60e-af995347d3ec None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:31.175052 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3135e4ef-c2bc-4660-b53d-bed2a28fa3c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:31.176034 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3135e4ef-c2bc-4660-b53d-bed2a28fa3c4 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:31.176532 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3135e4ef-c2bc-4660-b53d-bed2a28fa3c4 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:31.177019 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3135e4ef-c2bc-4660-b53d-bed2a28fa3c4 None admin] PATH_INFO: `/v3/roles` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:31.177876 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3135e4ef-c2bc-4660-b53d-bed2a28fa3c4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:26:31.179098 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3135e4ef-c2bc-4660-b53d-bed2a28fa3c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:31.180683 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3135e4ef-c2bc-4660-b53d-bed2a28fa3c4 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:31.193444 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 117/241] 10.222.0.104 () {56 vars in 1106 bytes} [Tue Aug 9 16:26:30 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 16:26:31.198779 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3135e4ef-c2bc-4660-b53d-bed2a28fa3c4 None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:31.254299 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:31.325937 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66b05de-5fe5-41b8-a60e-af995347d3ec None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:31.362011 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3135e4ef-c2bc-4660-b53d-bed2a28fa3c4 None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:31.387533 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ff758a-b94f-46c1-be83-4b00946739d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:31.388716 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ff758a-b94f-46c1-be83-4b00946739d1 None admin] REQUEST_METHOD: `POST` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:31.389308 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ff758a-b94f-46c1-be83-4b00946739d1 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:31.389789 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ff758a-b94f-46c1-be83-4b00946739d1 None admin] PATH_INFO: `/v3/users` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:31.390657 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ff758a-b94f-46c1-be83-4b00946739d1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:31.392473 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ff758a-b94f-46c1-be83-4b00946739d1 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:31.398727 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1a7c9b-3881-42f4-9ef5-bfd0e9b455ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:31.399376 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1a7c9b-3881-42f4-9ef5-bfd0e9b455ee None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:31.399658 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1a7c9b-3881-42f4-9ef5-bfd0e9b455ee None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:31.399931 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1a7c9b-3881-42f4-9ef5-bfd0e9b455ee None admin] PATH_INFO: `/v3/users/9b64ccd33db24d06b2838afaaf7cf7c7` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:31.404256 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:31.426254 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 125/242] 10.222.0.104 () {60 vars in 1137 bytes} [Tue Aug 9 16:26:31 2022] POST /identity/v3/users => generated 294 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 16:26:31.451739 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1a7c9b-3881-42f4-9ef5-bfd0e9b455ee None admin] RBAC: Authorizing `identity:get_user(user_id=9b64ccd33db24d06b2838afaaf7cf7c7)` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:31.453219 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1a7c9b-3881-42f4-9ef5-bfd0e9b455ee None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:31.455037 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 118/243] 10.222.0.104 () {56 vars in 1182 bytes} [Tue Aug 9 16:26:31 2022] GET /identity/v3/users/9b64ccd33db24d06b2838afaaf7cf7c7 => generated 298 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:26:31.461154 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ff758a-b94f-46c1-be83-4b00946739d1 None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:31.589835 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ff758a-b94f-46c1-be83-4b00946739d1 None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:31.630210 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b9eaf4-0416-49cc-9614-7d19954d623c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:31.631221 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b9eaf4-0416-49cc-9614-7d19954d623c None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:31.631725 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b9eaf4-0416-49cc-9614-7d19954d623c None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:31.632189 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b9eaf4-0416-49cc-9614-7d19954d623c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:31.705142 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:31.715024 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b9eaf4-0416-49cc-9614-7d19954d623c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:31.716862 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b9eaf4-0416-49cc-9614-7d19954d623c None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:31.837358 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 126/244] 10.222.0.104 () {58 vars in 1287 bytes} [Tue Aug 9 16:26:31 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 16:26:31.842645 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1a7c9b-3881-42f4-9ef5-bfd0e9b455ee None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:31.939398 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:31.955698 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1a7c9b-3881-42f4-9ef5-bfd0e9b455ee None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:31.973127 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f29d1ec-352b-4f6d-87b2-0e3e11b0a910 None None] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:31.973404 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f29d1ec-352b-4f6d-87b2-0e3e11b0a910 None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:31.973679 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f29d1ec-352b-4f6d-87b2-0e3e11b0a910 None None] PATH_INFO: `/` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:31.975062 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 127/245] 10.222.0.104 () {54 vars in 932 bytes} [Tue Aug 9 16:26:31 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 09 16:26:31.980644 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f16293b-54b9-40cd-b3f9-efeb31b0fd78 None None] REQUEST_METHOD: `POST` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:31.980931 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f16293b-54b9-40cd-b3f9-efeb31b0fd78 None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:31.981203 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f16293b-54b9-40cd-b3f9-efeb31b0fd78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:31.995585 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ece0917-6f77-411a-9a4c-f8a0b53e2b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:31.996718 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ece0917-6f77-411a-9a4c-f8a0b53e2b77 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:31.997195 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ece0917-6f77-411a-9a4c-f8a0b53e2b77 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:31.997662 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ece0917-6f77-411a-9a4c-f8a0b53e2b77 None admin] PATH_INFO: `/v3/projects/01f42016635a4e7ab655700eadbb1d93` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:31.999166 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ece0917-6f77-411a-9a4c-f8a0b53e2b77 None admin] RBAC: Authorizing `identity:get_project(project_id=01f42016635a4e7ab655700eadbb1d93)` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:32.000861 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ece0917-6f77-411a-9a4c-f8a0b53e2b77 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:32.002659 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.auth.core [None req-8f16293b-54b9-40cd-b3f9-efeb31b0fd78 None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:26:32.003264 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 119/246] 10.222.0.104 () {56 vars in 1191 bytes} [Tue Aug 9 16:26:31 2022] GET /identity/v3/projects/01f42016635a4e7ab655700eadbb1d93 => generated 303 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 16:26:32.004032 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.fernet_utils [None req-8f16293b-54b9-40cd-b3f9-efeb31b0fd78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:26:32.008791 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ece0917-6f77-411a-9a4c-f8a0b53e2b77 None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:32.106055 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 128/247] 10.222.0.104 () {58 vars in 1029 bytes} [Tue Aug 9 16:26:31 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 16:26:32.134551 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f16293b-54b9-40cd-b3f9-efeb31b0fd78 None None] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:32.139831 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ece0917-6f77-411a-9a4c-f8a0b53e2b77 None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:32.163867 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:32.259382 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f16293b-54b9-40cd-b3f9-efeb31b0fd78 None None] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:32.300932 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b410b89c-969d-4989-b422-4a0cd685daf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:32.301583 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b410b89c-969d-4989-b422-4a0cd685daf4 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:32.301947 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b410b89c-969d-4989-b422-4a0cd685daf4 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:32.302229 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b410b89c-969d-4989-b422-4a0cd685daf4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:32.316398 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b410b89c-969d-4989-b422-4a0cd685daf4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 16:26:32.321608 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdc0df8-ea55-4a9c-a755-68e6261625db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:32.322077 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application [None req-b410b89c-969d-4989-b422-4a0cd685daf4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 09 16:26:32.322077 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:26:32.322077 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:26:32.322077 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:26:32.322077 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:26:32.322077 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:26:32.322077 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:26:32.322077 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:26:32.322077 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:26:32.322077 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:26:32.322077 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:26:32.322077 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:26:32.322077 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 16:26:32.322077 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 16:26:32.322077 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 16:26:32.322077 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 16:26:32.322968 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 16:26:32.322968 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 16:26:32.322968 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 16:26:32.322968 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 16:26:32.322968 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:26:32.322968 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:26:32.322968 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:26:32.322968 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:26:32.322968 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:26:32.322968 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:26:32.322968 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:26:32.322968 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application with Lock( Aug 09 16:26:32.322968 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:26:32.322968 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:26:32.322968 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:26:32.322968 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:26:32.323757 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:26:32.323757 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:26:32.323757 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:26:32.323757 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:26:32.323757 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 16:26:32.323757 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 16:26:32.323757 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 16:26:32.323757 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 16:26:32.323757 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 16:26:32.323757 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 16:26:32.323757 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 09 16:26:32.323757 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Aug 09 16:26:32.325376 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdc0df8-ea55-4a9c-a755-68e6261625db None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:32.325823 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 129/248] 10.222.0.104 () {56 vars in 1104 bytes} [Tue Aug 9 16:26:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 16:26:32.326281 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdc0df8-ea55-4a9c-a755-68e6261625db None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:32.326747 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdc0df8-ea55-4a9c-a755-68e6261625db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:32.327706 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdc0df8-ea55-4a9c-a755-68e6261625db None admin] RBAC: Adding query filter params (role.id=92a80348b6cb4bb38f2a6a9f5facb705, scope.project.id=01f42016635a4e7ab655700eadbb1d93, user.id=9b64ccd33db24d06b2838afaaf7cf7c7) {{(pid=87276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:26:32.328216 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdc0df8-ea55-4a9c-a755-68e6261625db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:32.329936 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdc0df8-ea55-4a9c-a755-68e6261625db None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:32.330044 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5fc684-cab2-4c34-b86b-6b154535d3ef None None] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:32.330234 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5fc684-cab2-4c34-b86b-6b154535d3ef None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:32.330512 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5fc684-cab2-4c34-b86b-6b154535d3ef None None] PATH_INFO: `/` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:32.332154 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 130/249] 10.222.0.104 () {54 vars in 932 bytes} [Tue Aug 9 16:26:32 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:26:32.333586 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5fc684-cab2-4c34-b86b-6b154535d3ef None None] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:32.337533 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 120/250] 10.222.0.104 () {56 vars in 1379 bytes} [Tue Aug 9 16:26:32 2022] GET /identity/v3/role_assignments?user.id=9b64ccd33db24d06b2838afaaf7cf7c7&scope.project.id=01f42016635a4e7ab655700eadbb1d93&role.id=92a80348b6cb4bb38f2a6a9f5facb705 => generated 260 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:26:32.339261 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8113d1ea-9189-4bf5-817b-352c2af03ca9 None None] REQUEST_METHOD: `POST` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:32.339784 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8113d1ea-9189-4bf5-817b-352c2af03ca9 None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:32.340246 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8113d1ea-9189-4bf5-817b-352c2af03ca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:32.363217 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.auth.core [None req-8113d1ea-9189-4bf5-817b-352c2af03ca9 None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:26:32.364591 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.fernet_utils [None req-8113d1ea-9189-4bf5-817b-352c2af03ca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:26:32.380530 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:32.471756 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 121/251] 10.222.0.104 () {58 vars in 1029 bytes} [Tue Aug 9 16:26:32 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 16:26:32.472272 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:32.495559 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5fc684-cab2-4c34-b86b-6b154535d3ef None None] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:32.501886 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8113d1ea-9189-4bf5-817b-352c2af03ca9 None None] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:32.548880 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56f44e4-bdfc-4116-928e-2c486ddabdc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:32.549424 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56f44e4-bdfc-4116-928e-2c486ddabdc3 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:32.549705 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56f44e4-bdfc-4116-928e-2c486ddabdc3 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:32.550016 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56f44e4-bdfc-4116-928e-2c486ddabdc3 None admin] PATH_INFO: `/v3/roles` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:32.550698 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56f44e4-bdfc-4116-928e-2c486ddabdc3 None admin] RBAC: Adding query filter params (name=member) {{(pid=87275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:26:32.551003 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56f44e4-bdfc-4116-928e-2c486ddabdc3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:32.553048 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56f44e4-bdfc-4116-928e-2c486ddabdc3 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:32.562874 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 131/252] 10.222.0.104 () {56 vars in 1106 bytes} [Tue Aug 9 16:26:32 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:26:32.569040 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56f44e4-bdfc-4116-928e-2c486ddabdc3 None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:32.628251 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8113d1ea-9189-4bf5-817b-352c2af03ca9 None None] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:32.669258 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543d78a3-36f6-4656-8013-4df90e1add39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:32.670335 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543d78a3-36f6-4656-8013-4df90e1add39 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:32.670788 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543d78a3-36f6-4656-8013-4df90e1add39 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:32.671227 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543d78a3-36f6-4656-8013-4df90e1add39 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:32.683770 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543d78a3-36f6-4656-8013-4df90e1add39 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 16:26:32.692401 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application [None req-543d78a3-36f6-4656-8013-4df90e1add39 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 16:26:32.692401 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:26:32.692401 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:26:32.692401 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:26:32.692401 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:26:32.692401 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:26:32.692401 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:26:32.692401 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:26:32.692401 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:26:32.692401 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:26:32.692401 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:26:32.692401 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:26:32.692401 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 16:26:32.692401 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 16:26:32.692401 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 16:26:32.692401 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 16:26:32.693305 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 16:26:32.693305 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 16:26:32.693305 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 16:26:32.693305 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 16:26:32.693305 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:26:32.693305 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:26:32.693305 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:26:32.693305 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:26:32.693305 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:26:32.693305 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:26:32.693305 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:26:32.693305 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application with Lock( Aug 09 16:26:32.693305 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:26:32.693305 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:26:32.693305 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:26:32.693305 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:26:32.694107 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:26:32.694107 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:26:32.694107 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:26:32.694107 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:26:32.694107 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 16:26:32.694107 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 16:26:32.694107 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 16:26:32.694107 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 16:26:32.694107 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 16:26:32.694107 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 16:26:32.694107 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 16:26:32.694107 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Aug 09 16:26:32.696823 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 122/253] 10.222.0.104 () {56 vars in 1119 bytes} [Tue Aug 9 16:26:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 16:26:32.705329 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543d78a3-36f6-4656-8013-4df90e1add39 None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:32.721243 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:32.742447 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56f44e4-bdfc-4116-928e-2c486ddabdc3 None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:32.851467 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99751c6c-26c1-49ef-9021-67e2703aeb4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:32.852141 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99751c6c-26c1-49ef-9021-67e2703aeb4e None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:32.852420 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99751c6c-26c1-49ef-9021-67e2703aeb4e None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:32.852693 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99751c6c-26c1-49ef-9021-67e2703aeb4e None admin] PATH_INFO: `/v3/users/b3c8063bcbcb4876a6de609419db8379` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:32.854343 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99751c6c-26c1-49ef-9021-67e2703aeb4e None admin] RBAC: Authorizing `identity:get_user(user_id=b3c8063bcbcb4876a6de609419db8379)` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:32.855796 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99751c6c-26c1-49ef-9021-67e2703aeb4e None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:32.857778 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 132/254] 10.222.0.104 () {56 vars in 1182 bytes} [Tue Aug 9 16:26:32 2022] GET /identity/v3/users/b3c8063bcbcb4876a6de609419db8379 => generated 298 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:26:32.863479 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99751c6c-26c1-49ef-9021-67e2703aeb4e None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:32.876625 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543d78a3-36f6-4656-8013-4df90e1add39 None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:32.892226 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:32.963239 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203dfb3f-8a04-4dcf-8f51-01e335d5f1b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:32.963865 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203dfb3f-8a04-4dcf-8f51-01e335d5f1b7 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:32.964146 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203dfb3f-8a04-4dcf-8f51-01e335d5f1b7 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:32.964412 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203dfb3f-8a04-4dcf-8f51-01e335d5f1b7 None admin] PATH_INFO: `/v3/roles` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:32.965082 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203dfb3f-8a04-4dcf-8f51-01e335d5f1b7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:26:32.965379 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203dfb3f-8a04-4dcf-8f51-01e335d5f1b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:32.966795 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203dfb3f-8a04-4dcf-8f51-01e335d5f1b7 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:32.985366 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 123/255] 10.222.0.104 () {56 vars in 1116 bytes} [Tue Aug 9 16:26:32 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 16:26:32.995683 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203dfb3f-8a04-4dcf-8f51-01e335d5f1b7 None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:33.056932 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99751c6c-26c1-49ef-9021-67e2703aeb4e None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:33.121592 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeff72a-feba-4679-a4da-5165de9910e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:33.122703 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeff72a-feba-4679-a4da-5165de9910e9 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:33.123114 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeff72a-feba-4679-a4da-5165de9910e9 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:33.123540 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeff72a-feba-4679-a4da-5165de9910e9 None admin] PATH_INFO: `/v3/projects/01f42016635a4e7ab655700eadbb1d93` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:33.126626 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aeff72a-feba-4679-a4da-5165de9910e9 None admin] RBAC: Authorizing `identity:get_project(project_id=01f42016635a4e7ab655700eadbb1d93)` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:33.128083 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aeff72a-feba-4679-a4da-5165de9910e9 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:33.130901 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 133/256] 10.222.0.104 () {56 vars in 1191 bytes} [Tue Aug 9 16:26:32 2022] GET /identity/v3/projects/01f42016635a4e7ab655700eadbb1d93 => generated 303 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:26:33.136664 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeff72a-feba-4679-a4da-5165de9910e9 None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:33.154666 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:33.229739 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203dfb3f-8a04-4dcf-8f51-01e335d5f1b7 None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:33.301975 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a27bc5-f6e7-4c87-8ab5-9a5b4e30520c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:33.302620 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a27bc5-f6e7-4c87-8ab5-9a5b4e30520c None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:33.302899 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a27bc5-f6e7-4c87-8ab5-9a5b4e30520c None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:33.303170 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a27bc5-f6e7-4c87-8ab5-9a5b4e30520c None admin] PATH_INFO: `/v3/users/f8a35e8835eb4c6fbc9a8436f39972a0` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:33.310053 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a27bc5-f6e7-4c87-8ab5-9a5b4e30520c None admin] RBAC: Authorizing `identity:get_user(user_id=f8a35e8835eb4c6fbc9a8436f39972a0)` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:33.311524 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a27bc5-f6e7-4c87-8ab5-9a5b4e30520c None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:33.313951 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 124/257] 10.222.0.104 () {56 vars in 1182 bytes} [Tue Aug 9 16:26:32 2022] GET /identity/v3/users/f8a35e8835eb4c6fbc9a8436f39972a0 => generated 284 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 16:26:33.318924 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a27583-f9a3-4209-9840-2c2e83898c75 None None] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:33.319205 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a27583-f9a3-4209-9840-2c2e83898c75 None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:33.319479 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a27583-f9a3-4209-9840-2c2e83898c75 None None] PATH_INFO: `/` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:33.320692 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 125/258] 10.222.0.104 () {54 vars in 932 bytes} [Tue Aug 9 16:26:33 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:26:33.321390 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a27583-f9a3-4209-9840-2c2e83898c75 None None] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:33.325634 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:33.359621 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeff72a-feba-4679-a4da-5165de9910e9 None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:33.416490 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c138a628-3085-4b07-9e6e-7e5766539636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:33.417164 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c138a628-3085-4b07-9e6e-7e5766539636 None admin] REQUEST_METHOD: `PUT` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:33.417432 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c138a628-3085-4b07-9e6e-7e5766539636 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:33.417706 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c138a628-3085-4b07-9e6e-7e5766539636 None admin] PATH_INFO: `/v3/projects/01f42016635a4e7ab655700eadbb1d93/users/b3c8063bcbcb4876a6de609419db8379/roles/044ca4f80141492b9c128ada543865e8` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:33.423750 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c138a628-3085-4b07-9e6e-7e5766539636 None admin] RBAC: Authorizing `identity:create_grant(project_id=01f42016635a4e7ab655700eadbb1d93, user_id=b3c8063bcbcb4876a6de609419db8379, role_id=044ca4f80141492b9c128ada543865e8)` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:33.425225 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c138a628-3085-4b07-9e6e-7e5766539636 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:33.450390 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 134/259] 10.222.0.104 () {58 vars in 1444 bytes} [Tue Aug 9 16:26:33 2022] PUT /identity/v3/projects/01f42016635a4e7ab655700eadbb1d93/users/b3c8063bcbcb4876a6de609419db8379/roles/044ca4f80141492b9c128ada543865e8 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 16:26:33.451690 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01ce3bb-ce59-4b32-8a21-6284730aec20 None None] REQUEST_METHOD: `POST` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:33.451974 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01ce3bb-ce59-4b32-8a21-6284730aec20 None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:33.452252 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01ce3bb-ce59-4b32-8a21-6284730aec20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:33.512317 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.auth.core [None req-a01ce3bb-ce59-4b32-8a21-6284730aec20 None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:26:33.513581 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.fernet_utils [None req-a01ce3bb-ce59-4b32-8a21-6284730aec20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:26:33.552864 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a27583-f9a3-4209-9840-2c2e83898c75 None None] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:33.627436 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976aeb5a-b01e-4eb1-aaf1-b8d0a987567f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:33.628055 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976aeb5a-b01e-4eb1-aaf1-b8d0a987567f None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:33.628337 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976aeb5a-b01e-4eb1-aaf1-b8d0a987567f None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:33.628967 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976aeb5a-b01e-4eb1-aaf1-b8d0a987567f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:33.645662 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:33.679887 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 135/260] 10.222.0.104 () {58 vars in 1029 bytes} [Tue Aug 9 16:26:33 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 16:26:33.732424 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01ce3bb-ce59-4b32-8a21-6284730aec20 None None] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:33.747906 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976aeb5a-b01e-4eb1-aaf1-b8d0a987567f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:33.749593 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976aeb5a-b01e-4eb1-aaf1-b8d0a987567f None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:33.935304 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:33.945849 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 126/261] 10.222.0.104 () {58 vars in 1287 bytes} [Tue Aug 9 16:26:33 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 623 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 16:26:33.951970 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976aeb5a-b01e-4eb1-aaf1-b8d0a987567f None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:34.001995 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:34.002960 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01ce3bb-ce59-4b32-8a21-6284730aec20 None None] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:34.076684 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce26683-59c5-4afd-bd6a-dde61d0334b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:34.077328 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce26683-59c5-4afd-bd6a-dde61d0334b4 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:34.077601 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce26683-59c5-4afd-bd6a-dde61d0334b4 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:34.077869 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce26683-59c5-4afd-bd6a-dde61d0334b4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:34.101312 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce26683-59c5-4afd-bd6a-dde61d0334b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 16:26:34.106163 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application [None req-8ce26683-59c5-4afd-bd6a-dde61d0334b4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 16:26:34.106163 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:26:34.106163 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:26:34.106163 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:26:34.106163 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:26:34.106163 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:26:34.106163 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:26:34.106163 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:26:34.106163 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:26:34.106163 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:26:34.106163 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:26:34.106163 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:26:34.106163 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 16:26:34.106163 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 16:26:34.106163 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 16:26:34.106163 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 16:26:34.107044 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 16:26:34.107044 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 16:26:34.107044 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 16:26:34.107044 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 16:26:34.107044 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:26:34.107044 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:26:34.107044 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:26:34.107044 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:26:34.107044 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:26:34.107044 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:26:34.107044 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:26:34.107044 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application with Lock( Aug 09 16:26:34.107044 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:26:34.107044 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:26:34.107044 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:26:34.107044 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:26:34.107826 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:26:34.107826 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:26:34.107826 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:26:34.107826 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:26:34.107826 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 16:26:34.107826 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 16:26:34.107826 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 16:26:34.107826 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 16:26:34.107826 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 16:26:34.107826 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 16:26:34.107826 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 16:26:34.107826 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Aug 09 16:26:34.108927 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 136/262] 10.222.0.104 () {56 vars in 1101 bytes} [Tue Aug 9 16:26:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 377 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 16:26:34.114950 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce26683-59c5-4afd-bd6a-dde61d0334b4 None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:34.125516 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976aeb5a-b01e-4eb1-aaf1-b8d0a987567f None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:34.208248 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada637d5-7c2f-48ad-afee-68529dd0ae80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:34.209183 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada637d5-7c2f-48ad-afee-68529dd0ae80 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:34.209511 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada637d5-7c2f-48ad-afee-68529dd0ae80 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:34.209892 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada637d5-7c2f-48ad-afee-68529dd0ae80 None admin] PATH_INFO: `/v3/projects/01f42016635a4e7ab655700eadbb1d93` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:34.214704 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada637d5-7c2f-48ad-afee-68529dd0ae80 None admin] RBAC: Authorizing `identity:get_project(project_id=01f42016635a4e7ab655700eadbb1d93)` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:34.216159 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada637d5-7c2f-48ad-afee-68529dd0ae80 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:34.218326 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 127/263] 10.222.0.104 () {56 vars in 1191 bytes} [Tue Aug 9 16:26:33 2022] GET /identity/v3/projects/01f42016635a4e7ab655700eadbb1d93 => generated 303 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:26:34.224827 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada637d5-7c2f-48ad-afee-68529dd0ae80 None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:34.364674 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce26683-59c5-4afd-bd6a-dde61d0334b4 None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:34.434255 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:34.444343 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa50dda1-f539-47f7-ae16-a67b6e47af76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:34.444954 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa50dda1-f539-47f7-ae16-a67b6e47af76 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:34.445291 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa50dda1-f539-47f7-ae16-a67b6e47af76 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:34.445559 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa50dda1-f539-47f7-ae16-a67b6e47af76 None admin] PATH_INFO: `/v3/roles` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:34.446254 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa50dda1-f539-47f7-ae16-a67b6e47af76 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:26:34.446552 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa50dda1-f539-47f7-ae16-a67b6e47af76 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:34.447923 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa50dda1-f539-47f7-ae16-a67b6e47af76 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:34.463281 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada637d5-7c2f-48ad-afee-68529dd0ae80 None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:34.468077 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 137/264] 10.222.0.104 () {56 vars in 1104 bytes} [Tue Aug 9 16:26:34 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:26:34.473306 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:34.473936 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa50dda1-f539-47f7-ae16-a67b6e47af76 None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:34.527830 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b7cf5c-b62a-4100-9b7b-24ea00313f79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:34.528434 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b7cf5c-b62a-4100-9b7b-24ea00313f79 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:34.528712 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b7cf5c-b62a-4100-9b7b-24ea00313f79 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:34.528973 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b7cf5c-b62a-4100-9b7b-24ea00313f79 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:34.529745 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b7cf5c-b62a-4100-9b7b-24ea00313f79 None admin] RBAC: Adding query filter params (role.id=8a954d5b81f74df1985780d968ff3073, scope.project.id=01f42016635a4e7ab655700eadbb1d93, user.id=f8a35e8835eb4c6fbc9a8436f39972a0) {{(pid=87276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:26:34.530073 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b7cf5c-b62a-4100-9b7b-24ea00313f79 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:34.531560 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b7cf5c-b62a-4100-9b7b-24ea00313f79 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:34.544954 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 128/265] 10.222.0.104 () {56 vars in 1379 bytes} [Tue Aug 9 16:26:34 2022] GET /identity/v3/role_assignments?user.id=f8a35e8835eb4c6fbc9a8436f39972a0&scope.project.id=01f42016635a4e7ab655700eadbb1d93&role.id=8a954d5b81f74df1985780d968ff3073 => generated 610 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 16:26:34.648523 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa50dda1-f539-47f7-ae16-a67b6e47af76 None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:34.699837 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049f4470-9b68-489e-8329-e1b62252d410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:34.700475 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049f4470-9b68-489e-8329-e1b62252d410 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:34.700750 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049f4470-9b68-489e-8329-e1b62252d410 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:34.701020 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049f4470-9b68-489e-8329-e1b62252d410 None admin] PATH_INFO: `/v3/users/f8a35e8835eb4c6fbc9a8436f39972a0` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:34.702321 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049f4470-9b68-489e-8329-e1b62252d410 None admin] RBAC: Authorizing `identity:get_user(user_id=f8a35e8835eb4c6fbc9a8436f39972a0)` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:34.704309 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049f4470-9b68-489e-8329-e1b62252d410 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:34.706072 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 138/266] 10.222.0.104 () {56 vars in 1182 bytes} [Tue Aug 9 16:26:34 2022] GET /identity/v3/users/f8a35e8835eb4c6fbc9a8436f39972a0 => generated 284 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 16:26:34.711806 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b7cf5c-b62a-4100-9b7b-24ea00313f79 None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:34.858223 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b7cf5c-b62a-4100-9b7b-24ea00313f79 None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:34.902241 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6c6b2c-5d5e-492e-ab3b-acebbeddde88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:34.902857 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6c6b2c-5d5e-492e-ab3b-acebbeddde88 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:34.903135 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6c6b2c-5d5e-492e-ab3b-acebbeddde88 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:34.903407 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6c6b2c-5d5e-492e-ab3b-acebbeddde88 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:34.953094 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:34.989635 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6c6b2c-5d5e-492e-ab3b-acebbeddde88 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:34.991143 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6c6b2c-5d5e-492e-ab3b-acebbeddde88 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:35.103067 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 129/267] 10.222.0.104 () {58 vars in 1287 bytes} [Tue Aug 9 16:26:34 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 16:26:35.109085 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049f4470-9b68-489e-8329-e1b62252d410 None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:35.180395 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:35.222716 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049f4470-9b68-489e-8329-e1b62252d410 None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:35.261156 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed1ea97-6b8d-44c4-ac4f-40f59a665801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:35.261789 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed1ea97-6b8d-44c4-ac4f-40f59a665801 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:35.262087 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed1ea97-6b8d-44c4-ac4f-40f59a665801 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:35.262358 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed1ea97-6b8d-44c4-ac4f-40f59a665801 None admin] PATH_INFO: `/v3/projects/01f42016635a4e7ab655700eadbb1d93` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:35.263471 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed1ea97-6b8d-44c4-ac4f-40f59a665801 None admin] RBAC: Authorizing `identity:get_project(project_id=01f42016635a4e7ab655700eadbb1d93)` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:35.265174 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed1ea97-6b8d-44c4-ac4f-40f59a665801 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:35.267455 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 139/268] 10.222.0.104 () {56 vars in 1191 bytes} [Tue Aug 9 16:26:35 2022] GET /identity/v3/projects/01f42016635a4e7ab655700eadbb1d93 => generated 303 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:26:35.273282 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6c6b2c-5d5e-492e-ab3b-acebbeddde88 None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:35.361223 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:35.399860 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22ee623-28bd-43e1-ae0a-95a56b2b76ea None None] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:35.400295 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22ee623-28bd-43e1-ae0a-95a56b2b76ea None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:35.400660 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22ee623-28bd-43e1-ae0a-95a56b2b76ea None None] PATH_INFO: `/` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:35.402141 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 140/269] 10.222.0.104 () {54 vars in 932 bytes} [Tue Aug 9 16:26:35 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:26:35.406440 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6c6b2c-5d5e-492e-ab3b-acebbeddde88 None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:35.407339 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084ec46e-e444-4e53-bead-3bb119096331 None None] REQUEST_METHOD: `POST` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:35.407690 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084ec46e-e444-4e53-bead-3bb119096331 None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:35.407969 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084ec46e-e444-4e53-bead-3bb119096331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:35.426835 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.auth.core [None req-084ec46e-e444-4e53-bead-3bb119096331 None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:26:35.428300 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.fernet_utils [None req-084ec46e-e444-4e53-bead-3bb119096331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:26:35.470071 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fb8e27-d8e6-434a-9c6c-22f69b4c106e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:35.470687 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fb8e27-d8e6-434a-9c6c-22f69b4c106e None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:35.470961 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fb8e27-d8e6-434a-9c6c-22f69b4c106e None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:35.471229 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fb8e27-d8e6-434a-9c6c-22f69b4c106e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:35.471952 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fb8e27-d8e6-434a-9c6c-22f69b4c106e None admin] RBAC: Adding query filter params (role.id=c0143e35c1344a39a931bbb6bcd5acdc, scope.project.id=01f42016635a4e7ab655700eadbb1d93, user.id=f8a35e8835eb4c6fbc9a8436f39972a0) {{(pid=87276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:26:35.472254 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fb8e27-d8e6-434a-9c6c-22f69b4c106e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:35.473682 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fb8e27-d8e6-434a-9c6c-22f69b4c106e None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:35.490204 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 130/270] 10.222.0.104 () {56 vars in 1379 bytes} [Tue Aug 9 16:26:35 2022] GET /identity/v3/role_assignments?user.id=f8a35e8835eb4c6fbc9a8436f39972a0&scope.project.id=01f42016635a4e7ab655700eadbb1d93&role.id=c0143e35c1344a39a931bbb6bcd5acdc => generated 610 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:26:35.536237 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 141/271] 10.222.0.104 () {58 vars in 1029 bytes} [Tue Aug 9 16:26:35 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 16:26:35.573403 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fb8e27-d8e6-434a-9c6c-22f69b4c106e None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:35.715972 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fb8e27-d8e6-434a-9c6c-22f69b4c106e None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:35.734192 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee2d5dd-0e9f-4359-bf28-4d3b870d51c8 None None] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:35.737053 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee2d5dd-0e9f-4359-bf28-4d3b870d51c8 None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:35.737344 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee2d5dd-0e9f-4359-bf28-4d3b870d51c8 None None] PATH_INFO: `/` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:35.742373 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 142/272] 10.222.0.104 () {54 vars in 932 bytes} [Tue Aug 9 16:26:35 2022] GET /identity => generated 271 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:26:35.747395 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d252586b-9b5a-4dc7-b1aa-29ae497053e3 None None] REQUEST_METHOD: `POST` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:35.747670 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d252586b-9b5a-4dc7-b1aa-29ae497053e3 None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:35.747939 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d252586b-9b5a-4dc7-b1aa-29ae497053e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:35.761337 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d22e097-bcea-4f6d-bbed-772ecafc803e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:35.762823 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d22e097-bcea-4f6d-bbed-772ecafc803e None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:35.762823 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d22e097-bcea-4f6d-bbed-772ecafc803e None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:35.762823 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d22e097-bcea-4f6d-bbed-772ecafc803e None admin] PATH_INFO: `/v3/roles/member` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:35.764605 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:35.777576 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.auth.core [None req-d252586b-9b5a-4dc7-b1aa-29ae497053e3 None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:26:35.778797 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.fernet_utils [None req-d252586b-9b5a-4dc7-b1aa-29ae497053e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:26:35.786996 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d22e097-bcea-4f6d-bbed-772ecafc803e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 16:26:35.794588 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application [None req-6d22e097-bcea-4f6d-bbed-772ecafc803e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 09 16:26:35.794588 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:26:35.794588 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:26:35.794588 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:26:35.794588 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:26:35.794588 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:26:35.794588 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:26:35.794588 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:26:35.794588 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:26:35.794588 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:26:35.794588 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:26:35.794588 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:26:35.794588 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 16:26:35.794588 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 16:26:35.794588 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 16:26:35.794588 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 16:26:35.795473 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 16:26:35.795473 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 16:26:35.795473 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 16:26:35.795473 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 16:26:35.795473 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:26:35.795473 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:26:35.795473 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:26:35.795473 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:26:35.795473 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:26:35.795473 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:26:35.795473 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:26:35.795473 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application with Lock( Aug 09 16:26:35.795473 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:26:35.795473 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:26:35.795473 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:26:35.795473 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:26:35.796245 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:26:35.796245 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:26:35.796245 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:26:35.796245 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:26:35.796245 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 16:26:35.796245 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 16:26:35.796245 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 16:26:35.796245 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 16:26:35.796245 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 16:26:35.796245 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 16:26:35.796245 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 09 16:26:35.796245 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Aug 09 16:26:35.799780 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 131/273] 10.222.0.104 () {56 vars in 1104 bytes} [Tue Aug 9 16:26:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 16:26:35.804893 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d22e097-bcea-4f6d-bbed-772ecafc803e None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:35.853261 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:35.870429 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 143/274] 10.222.0.104 () {58 vars in 1029 bytes} [Tue Aug 9 16:26:35 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 16:26:35.895736 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570e5566-b2fb-4dcf-996a-7fc445e30b86 None None] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:35.896161 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570e5566-b2fb-4dcf-996a-7fc445e30b86 None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:35.896555 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570e5566-b2fb-4dcf-996a-7fc445e30b86 None None] PATH_INFO: `/` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:35.898278 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 144/275] 10.222.0.104 () {54 vars in 932 bytes} [Tue Aug 9 16:26:35 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:26:35.905222 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d3341f-3c8b-4ca4-aaa2-1910dc724035 None None] REQUEST_METHOD: `POST` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:35.905498 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d3341f-3c8b-4ca4-aaa2-1910dc724035 None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:35.905767 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d3341f-3c8b-4ca4-aaa2-1910dc724035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:35.924838 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.auth.core [None req-99d3341f-3c8b-4ca4-aaa2-1910dc724035 None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:26:35.926276 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.fernet_utils [None req-99d3341f-3c8b-4ca4-aaa2-1910dc724035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:26:35.946152 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d22e097-bcea-4f6d-bbed-772ecafc803e None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:35.982914 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde58bcf-c5cd-4028-8695-0cb0cc1bdcac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:35.983610 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde58bcf-c5cd-4028-8695-0cb0cc1bdcac None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:35.983692 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde58bcf-c5cd-4028-8695-0cb0cc1bdcac None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:35.983959 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde58bcf-c5cd-4028-8695-0cb0cc1bdcac None admin] PATH_INFO: `/v3/roles` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:35.985273 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde58bcf-c5cd-4028-8695-0cb0cc1bdcac None admin] RBAC: Adding query filter params (name=member) {{(pid=87276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:26:35.986051 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde58bcf-c5cd-4028-8695-0cb0cc1bdcac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:35.987434 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde58bcf-c5cd-4028-8695-0cb0cc1bdcac None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:35.996219 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 132/276] 10.222.0.104 () {56 vars in 1106 bytes} [Tue Aug 9 16:26:35 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:26:35.998937 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde58bcf-c5cd-4028-8695-0cb0cc1bdcac None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:35.999549 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 145/277] 10.222.0.104 () {58 vars in 1029 bytes} [Tue Aug 9 16:26:35 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 16:26:36.001770 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d3341f-3c8b-4ca4-aaa2-1910dc724035 None None] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:36.073194 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:36.110029 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d3341f-3c8b-4ca4-aaa2-1910dc724035 None None] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:36.127728 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde58bcf-c5cd-4028-8695-0cb0cc1bdcac None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:36.132064 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:36.146992 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e20c1e1-fe3b-4c9d-a785-bd3aaf1cd794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:36.147622 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e20c1e1-fe3b-4c9d-a785-bd3aaf1cd794 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:36.147897 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e20c1e1-fe3b-4c9d-a785-bd3aaf1cd794 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:36.148167 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e20c1e1-fe3b-4c9d-a785-bd3aaf1cd794 None admin] PATH_INFO: `/v3/users/568c5eaf072149a68d4b696c06669688` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:36.161877 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e20c1e1-fe3b-4c9d-a785-bd3aaf1cd794 None admin] RBAC: Authorizing `identity:get_user(user_id=568c5eaf072149a68d4b696c06669688)` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:36.163357 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e20c1e1-fe3b-4c9d-a785-bd3aaf1cd794 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:36.164991 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 146/278] 10.222.0.104 () {56 vars in 1182 bytes} [Tue Aug 9 16:26:36 2022] GET /identity/v3/users/568c5eaf072149a68d4b696c06669688 => generated 294 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 16:26:36.169680 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e20c1e1-fe3b-4c9d-a785-bd3aaf1cd794 None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:36.170608 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb136dd-ddec-4cf7-b334-701b8c74bd5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:36.171246 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb136dd-ddec-4cf7-b334-701b8c74bd5b None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:36.171523 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb136dd-ddec-4cf7-b334-701b8c74bd5b None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:36.171848 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb136dd-ddec-4cf7-b334-701b8c74bd5b None admin] PATH_INFO: `/v3/domains/default` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:36.173487 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb136dd-ddec-4cf7-b334-701b8c74bd5b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:36.174972 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb136dd-ddec-4cf7-b334-701b8c74bd5b None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:36.176741 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 133/279] 10.222.0.104 () {56 vars in 1113 bytes} [Tue Aug 9 16:26:35 2022] GET /identity/v3/domains/default => generated 200 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:26:36.181795 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb136dd-ddec-4cf7-b334-701b8c74bd5b None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:36.271535 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e20c1e1-fe3b-4c9d-a785-bd3aaf1cd794 None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:36.290780 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb136dd-ddec-4cf7-b334-701b8c74bd5b None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:36.306255 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203e3b55-920e-4d75-a7bf-419c3c3d045a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:36.306894 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203e3b55-920e-4d75-a7bf-419c3c3d045a None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:36.307188 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203e3b55-920e-4d75-a7bf-419c3c3d045a None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:36.307435 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203e3b55-920e-4d75-a7bf-419c3c3d045a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:36.316820 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:36.317818 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203e3b55-920e-4d75-a7bf-419c3c3d045a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 16:26:36.322659 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application [None req-203e3b55-920e-4d75-a7bf-419c3c3d045a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 09 16:26:36.322659 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:26:36.322659 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:26:36.322659 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:26:36.322659 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:26:36.322659 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:26:36.322659 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:26:36.322659 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:26:36.322659 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:26:36.322659 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:26:36.322659 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:26:36.322659 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:26:36.322659 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 16:26:36.322659 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 16:26:36.322659 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 16:26:36.322659 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 16:26:36.323570 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 16:26:36.323570 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 16:26:36.323570 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 16:26:36.323570 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 16:26:36.323570 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:26:36.323570 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:26:36.323570 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:26:36.323570 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:26:36.323570 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:26:36.323570 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:26:36.323570 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:26:36.323570 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application with Lock( Aug 09 16:26:36.323570 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:26:36.323570 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:26:36.323570 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:26:36.323570 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:26:36.324348 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:26:36.324348 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:26:36.324348 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:26:36.324348 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:26:36.324348 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 16:26:36.324348 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 16:26:36.324348 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 16:26:36.324348 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 16:26:36.324348 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 16:26:36.324348 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 16:26:36.324348 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 09 16:26:36.324348 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Aug 09 16:26:36.331711 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91355a4b-eb67-46d6-b7c7-9768648fd154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:36.332322 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91355a4b-eb67-46d6-b7c7-9768648fd154 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:36.332774 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91355a4b-eb67-46d6-b7c7-9768648fd154 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:36.332873 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 147/280] 10.222.0.104 () {56 vars in 1104 bytes} [Tue Aug 9 16:26:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 16:26:36.332945 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91355a4b-eb67-46d6-b7c7-9768648fd154 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:36.333556 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203e3b55-920e-4d75-a7bf-419c3c3d045a None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:36.333664 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91355a4b-eb67-46d6-b7c7-9768648fd154 None admin] RBAC: Adding query filter params (role.id=044ca4f80141492b9c128ada543865e8, user.id=568c5eaf072149a68d4b696c06669688, scope.system=all) {{(pid=87276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:26:36.333887 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91355a4b-eb67-46d6-b7c7-9768648fd154 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:36.336920 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91355a4b-eb67-46d6-b7c7-9768648fd154 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:36.346048 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 134/281] 10.222.0.104 () {56 vars in 1313 bytes} [Tue Aug 9 16:26:36 2022] GET /identity/v3/role_assignments?user.id=568c5eaf072149a68d4b696c06669688&scope.system=all&role.id=044ca4f80141492b9c128ada543865e8 => generated 227 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:26:36.346712 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91355a4b-eb67-46d6-b7c7-9768648fd154 None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:36.401490 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:36.475961 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91355a4b-eb67-46d6-b7c7-9768648fd154 None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:36.501232 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203e3b55-920e-4d75-a7bf-419c3c3d045a None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:36.518230 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3121d5b4-8768-42f5-af06-6847a392ef57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:36.518853 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3121d5b4-8768-42f5-af06-6847a392ef57 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:36.519133 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3121d5b4-8768-42f5-af06-6847a392ef57 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:36.519407 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3121d5b4-8768-42f5-af06-6847a392ef57 None admin] PATH_INFO: `/v3/roles` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:36.520200 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3121d5b4-8768-42f5-af06-6847a392ef57 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:26:36.520500 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3121d5b4-8768-42f5-af06-6847a392ef57 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:36.522051 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3121d5b4-8768-42f5-af06-6847a392ef57 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:36.532456 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 135/282] 10.222.0.104 () {56 vars in 1106 bytes} [Tue Aug 9 16:26:36 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:26:36.538426 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3121d5b4-8768-42f5-af06-6847a392ef57 None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:36.552904 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d59fb2-c0ea-4f4c-a445-69a3ba73cd1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:36.553515 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d59fb2-c0ea-4f4c-a445-69a3ba73cd1c None admin] REQUEST_METHOD: `POST` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:36.553792 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d59fb2-c0ea-4f4c-a445-69a3ba73cd1c None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:36.554092 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d59fb2-c0ea-4f4c-a445-69a3ba73cd1c None admin] PATH_INFO: `/v3/users` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:36.554736 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d59fb2-c0ea-4f4c-a445-69a3ba73cd1c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:36.556824 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d59fb2-c0ea-4f4c-a445-69a3ba73cd1c None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:36.588450 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 148/283] 10.222.0.104 () {60 vars in 1137 bytes} [Tue Aug 9 16:26:36 2022] POST /identity/v3/users => generated 294 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 16:26:36.623816 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:36.690923 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3121d5b4-8768-42f5-af06-6847a392ef57 None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:36.716948 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa49853c-2833-49cc-93ca-f03548acfd03 None None] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:36.717292 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa49853c-2833-49cc-93ca-f03548acfd03 None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:36.717700 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa49853c-2833-49cc-93ca-f03548acfd03 None None] PATH_INFO: `/` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:36.719241 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 149/284] 10.222.0.104 () {54 vars in 932 bytes} [Tue Aug 9 16:26:36 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 09 16:26:36.731345 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6700b98-5fb0-42d1-b028-e849f15eda0a None None] REQUEST_METHOD: `POST` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:36.731798 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6700b98-5fb0-42d1-b028-e849f15eda0a None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:36.732055 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6700b98-5fb0-42d1-b028-e849f15eda0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:36.749073 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d19ea8c-7977-4abd-9126-e1d3bac2c61a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:36.749794 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d19ea8c-7977-4abd-9126-e1d3bac2c61a None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:36.750742 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d19ea8c-7977-4abd-9126-e1d3bac2c61a None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:36.751190 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d19ea8c-7977-4abd-9126-e1d3bac2c61a None admin] PATH_INFO: `/v3/users/9b64ccd33db24d06b2838afaaf7cf7c7` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:36.756209 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d19ea8c-7977-4abd-9126-e1d3bac2c61a None admin] RBAC: Authorizing `identity:get_user(user_id=9b64ccd33db24d06b2838afaaf7cf7c7)` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:36.757295 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d19ea8c-7977-4abd-9126-e1d3bac2c61a None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:36.759184 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.auth.core [None req-c6700b98-5fb0-42d1-b028-e849f15eda0a None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:26:36.759925 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 136/285] 10.222.0.104 () {56 vars in 1182 bytes} [Tue Aug 9 16:26:36 2022] GET /identity/v3/users/9b64ccd33db24d06b2838afaaf7cf7c7 => generated 298 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:26:36.769778 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.fernet_utils [None req-c6700b98-5fb0-42d1-b028-e849f15eda0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:26:36.778891 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d19ea8c-7977-4abd-9126-e1d3bac2c61a None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:36.864963 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 150/286] 10.222.0.104 () {58 vars in 1029 bytes} [Tue Aug 9 16:26:36 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 16:26:36.890548 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6700b98-5fb0-42d1-b028-e849f15eda0a None None] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:36.912001 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d19ea8c-7977-4abd-9126-e1d3bac2c61a None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:36.926696 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:36.936372 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:36.957261 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cbaa9d-8ca3-4b7a-93af-597e751d9aa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:36.957929 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cbaa9d-8ca3-4b7a-93af-597e751d9aa2 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:36.958213 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cbaa9d-8ca3-4b7a-93af-597e751d9aa2 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:36.958482 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cbaa9d-8ca3-4b7a-93af-597e751d9aa2 None admin] PATH_INFO: `/v3/projects/01f42016635a4e7ab655700eadbb1d93` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:36.959644 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cbaa9d-8ca3-4b7a-93af-597e751d9aa2 None admin] RBAC: Authorizing `identity:get_project(project_id=01f42016635a4e7ab655700eadbb1d93)` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:36.961312 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cbaa9d-8ca3-4b7a-93af-597e751d9aa2 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:36.963232 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 137/287] 10.222.0.104 () {56 vars in 1191 bytes} [Tue Aug 9 16:26:36 2022] GET /identity/v3/projects/01f42016635a4e7ab655700eadbb1d93 => generated 303 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:26:36.969522 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cbaa9d-8ca3-4b7a-93af-597e751d9aa2 None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:37.035632 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6700b98-5fb0-42d1-b028-e849f15eda0a None None] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:37.077194 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6c553a-22ab-4a4a-9696-3834d8a49751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:37.079148 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6c553a-22ab-4a4a-9696-3834d8a49751 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:37.079848 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6c553a-22ab-4a4a-9696-3834d8a49751 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:37.080127 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6c553a-22ab-4a4a-9696-3834d8a49751 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:37.096668 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6c553a-22ab-4a4a-9696-3834d8a49751 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 16:26:37.103795 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application [None req-db6c553a-22ab-4a4a-9696-3834d8a49751 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 09 16:26:37.103795 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:26:37.103795 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:26:37.103795 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:26:37.103795 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:26:37.103795 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:26:37.103795 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:26:37.103795 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:26:37.103795 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:26:37.103795 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:26:37.103795 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:26:37.103795 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:26:37.103795 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 16:26:37.103795 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 16:26:37.103795 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 16:26:37.103795 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 16:26:37.104689 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 16:26:37.104689 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 16:26:37.104689 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 16:26:37.104689 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 16:26:37.104689 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:26:37.104689 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:26:37.104689 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:26:37.104689 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:26:37.104689 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:26:37.104689 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:26:37.104689 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:26:37.104689 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application with Lock( Aug 09 16:26:37.104689 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:26:37.104689 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:26:37.104689 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:26:37.104689 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:26:37.105502 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:26:37.105502 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:26:37.105502 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:26:37.105502 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:26:37.105502 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 16:26:37.105502 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 16:26:37.105502 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 16:26:37.105502 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 16:26:37.105502 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 16:26:37.105502 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 16:26:37.105502 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 09 16:26:37.105502 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Aug 09 16:26:37.105502 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 151/288] 10.222.0.104 () {56 vars in 1104 bytes} [Tue Aug 9 16:26:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 16:26:37.109093 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cbaa9d-8ca3-4b7a-93af-597e751d9aa2 None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:37.112324 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6c553a-22ab-4a4a-9696-3834d8a49751 None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:37.148322 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ecd535-4f28-4e82-af05-56e9a43c2ef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:37.148992 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ecd535-4f28-4e82-af05-56e9a43c2ef1 None admin] REQUEST_METHOD: `PUT` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:37.149272 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ecd535-4f28-4e82-af05-56e9a43c2ef1 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:37.149541 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ecd535-4f28-4e82-af05-56e9a43c2ef1 None admin] PATH_INFO: `/v3/projects/01f42016635a4e7ab655700eadbb1d93/users/9b64ccd33db24d06b2838afaaf7cf7c7/roles/92a80348b6cb4bb38f2a6a9f5facb705` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:37.151514 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ecd535-4f28-4e82-af05-56e9a43c2ef1 None admin] RBAC: Authorizing `identity:create_grant(project_id=01f42016635a4e7ab655700eadbb1d93, user_id=9b64ccd33db24d06b2838afaaf7cf7c7, role_id=92a80348b6cb4bb38f2a6a9f5facb705)` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:37.152973 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ecd535-4f28-4e82-af05-56e9a43c2ef1 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:37.180499 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 138/289] 10.222.0.104 () {58 vars in 1444 bytes} [Tue Aug 9 16:26:36 2022] PUT /identity/v3/projects/01f42016635a4e7ab655700eadbb1d93/users/9b64ccd33db24d06b2838afaaf7cf7c7/roles/92a80348b6cb4bb38f2a6a9f5facb705 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 16:26:37.211235 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:37.224088 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6c553a-22ab-4a4a-9696-3834d8a49751 None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:37.262940 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972d880c-60ad-433e-83b0-b9c65906c329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:37.263609 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972d880c-60ad-433e-83b0-b9c65906c329 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:37.263894 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972d880c-60ad-433e-83b0-b9c65906c329 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:37.264167 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972d880c-60ad-433e-83b0-b9c65906c329 None admin] PATH_INFO: `/v3/roles` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:37.264838 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972d880c-60ad-433e-83b0-b9c65906c329 None admin] RBAC: Adding query filter params (name=member) {{(pid=87275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:26:37.265140 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972d880c-60ad-433e-83b0-b9c65906c329 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:37.266595 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972d880c-60ad-433e-83b0-b9c65906c329 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:37.276130 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 152/290] 10.222.0.104 () {56 vars in 1106 bytes} [Tue Aug 9 16:26:37 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:26:37.282336 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ecd535-4f28-4e82-af05-56e9a43c2ef1 None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:37.338716 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:37.409985 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ecd535-4f28-4e82-af05-56e9a43c2ef1 None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:37.457011 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d31e96-226e-437b-b1b3-a02e472a9ec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:37.457652 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d31e96-226e-437b-b1b3-a02e472a9ec3 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:37.457958 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d31e96-226e-437b-b1b3-a02e472a9ec3 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:37.458243 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d31e96-226e-437b-b1b3-a02e472a9ec3 None admin] PATH_INFO: `/v3/users/b3c8063bcbcb4876a6de609419db8379` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:37.459409 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d31e96-226e-437b-b1b3-a02e472a9ec3 None admin] RBAC: Authorizing `identity:get_user(user_id=b3c8063bcbcb4876a6de609419db8379)` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:37.461236 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d31e96-226e-437b-b1b3-a02e472a9ec3 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:37.462880 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 139/291] 10.222.0.104 () {56 vars in 1182 bytes} [Tue Aug 9 16:26:37 2022] GET /identity/v3/users/b3c8063bcbcb4876a6de609419db8379 => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:26:37.469140 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972d880c-60ad-433e-83b0-b9c65906c329 None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:37.583604 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972d880c-60ad-433e-83b0-b9c65906c329 None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:37.625979 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fee626-6c07-499d-9369-399d24774427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:37.626534 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fee626-6c07-499d-9369-399d24774427 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:37.626813 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fee626-6c07-499d-9369-399d24774427 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:37.627086 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fee626-6c07-499d-9369-399d24774427 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:37.649006 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:37.714226 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fee626-6c07-499d-9369-399d24774427 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:37.715695 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fee626-6c07-499d-9369-399d24774427 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:37.859684 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 153/292] 10.222.0.104 () {58 vars in 1287 bytes} [Tue Aug 9 16:26:37 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 16:26:37.865425 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d31e96-226e-437b-b1b3-a02e472a9ec3 None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:38.026864 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d31e96-226e-437b-b1b3-a02e472a9ec3 None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:38.053224 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:38.084474 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea64ec79-b257-4145-ae30-2b11067170ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:38.085109 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea64ec79-b257-4145-ae30-2b11067170ea None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:38.085385 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea64ec79-b257-4145-ae30-2b11067170ea None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:38.085710 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea64ec79-b257-4145-ae30-2b11067170ea None admin] PATH_INFO: `/v3/projects/01f42016635a4e7ab655700eadbb1d93` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:38.086918 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea64ec79-b257-4145-ae30-2b11067170ea None admin] RBAC: Authorizing `identity:get_project(project_id=01f42016635a4e7ab655700eadbb1d93)` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:38.088429 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea64ec79-b257-4145-ae30-2b11067170ea None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:38.090141 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 140/293] 10.222.0.104 () {56 vars in 1191 bytes} [Tue Aug 9 16:26:37 2022] GET /identity/v3/projects/01f42016635a4e7ab655700eadbb1d93 => generated 303 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:26:38.096294 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fee626-6c07-499d-9369-399d24774427 None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:38.176954 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:38.260540 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fee626-6c07-499d-9369-399d24774427 None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:38.296283 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a91b8b-df63-4c8e-8438-b238399e459b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:38.297462 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a91b8b-df63-4c8e-8438-b238399e459b None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:38.297749 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a91b8b-df63-4c8e-8438-b238399e459b None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:38.298050 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a91b8b-df63-4c8e-8438-b238399e459b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:38.298773 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a91b8b-df63-4c8e-8438-b238399e459b None admin] RBAC: Adding query filter params (role.id=044ca4f80141492b9c128ada543865e8, scope.project.id=01f42016635a4e7ab655700eadbb1d93, user.id=b3c8063bcbcb4876a6de609419db8379) {{(pid=87275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:26:38.299082 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a91b8b-df63-4c8e-8438-b238399e459b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:38.300590 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a91b8b-df63-4c8e-8438-b238399e459b None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:38.306650 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 154/294] 10.222.0.104 () {56 vars in 1379 bytes} [Tue Aug 9 16:26:38 2022] GET /identity/v3/role_assignments?user.id=b3c8063bcbcb4876a6de609419db8379&scope.project.id=01f42016635a4e7ab655700eadbb1d93&role.id=044ca4f80141492b9c128ada543865e8 => generated 610 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:26:39.363794 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ddefed-2bcc-451f-9bec-f72517d039a8 None None] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:39.364338 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ddefed-2bcc-451f-9bec-f72517d039a8 None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:39.364416 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ddefed-2bcc-451f-9bec-f72517d039a8 None None] PATH_INFO: `/` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:39.366204 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 141/295] 10.222.0.104 () {54 vars in 932 bytes} [Tue Aug 9 16:26:39 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:26:39.372041 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474a354f-6cf7-4908-a38a-6ee880addbac None None] REQUEST_METHOD: `POST` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:39.373015 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474a354f-6cf7-4908-a38a-6ee880addbac None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:39.373517 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474a354f-6cf7-4908-a38a-6ee880addbac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:39.393988 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.auth.core [None req-474a354f-6cf7-4908-a38a-6ee880addbac None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:26:39.395550 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.fernet_utils [None req-474a354f-6cf7-4908-a38a-6ee880addbac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:26:39.468098 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1259378d-ade0-43ff-a624-17255ef01db2 None None] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:39.468771 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1259378d-ade0-43ff-a624-17255ef01db2 None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:39.469248 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1259378d-ade0-43ff-a624-17255ef01db2 None None] PATH_INFO: `/` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:39.470813 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 142/296] 10.222.0.104 () {54 vars in 932 bytes} [Tue Aug 9 16:26:39 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 09 16:26:39.476467 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b1ca21-40fe-4274-bc18-795143926247 None None] REQUEST_METHOD: `POST` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:39.476999 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b1ca21-40fe-4274-bc18-795143926247 None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:39.477470 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b1ca21-40fe-4274-bc18-795143926247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:39.478162 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 155/297] 10.222.0.104 () {58 vars in 1029 bytes} [Tue Aug 9 16:26:39 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 16:26:39.497729 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.auth.core [None req-05b1ca21-40fe-4274-bc18-795143926247 None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:26:39.497978 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474a354f-6cf7-4908-a38a-6ee880addbac None None] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:39.499412 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.fernet_utils [None req-05b1ca21-40fe-4274-bc18-795143926247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:26:39.541511 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:39.586020 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 143/298] 10.222.0.104 () {58 vars in 1029 bytes} [Tue Aug 9 16:26:39 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 16:26:39.604219 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474a354f-6cf7-4908-a38a-6ee880addbac None None] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:39.605128 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b1ca21-40fe-4274-bc18-795143926247 None None] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:39.640487 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d01723-ba51-4e96-9532-a7734c64112e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:39.641036 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d01723-ba51-4e96-9532-a7734c64112e None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:39.641313 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d01723-ba51-4e96-9532-a7734c64112e None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:39.641582 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d01723-ba51-4e96-9532-a7734c64112e None admin] PATH_INFO: `/v3/roles/member` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:39.652468 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d01723-ba51-4e96-9532-a7734c64112e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 16:26:39.657944 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application [None req-16d01723-ba51-4e96-9532-a7734c64112e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 09 16:26:39.657944 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:26:39.657944 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:26:39.657944 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:26:39.657944 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:26:39.657944 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:26:39.657944 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:26:39.657944 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:26:39.657944 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:26:39.657944 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:26:39.657944 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:26:39.657944 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:26:39.657944 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 16:26:39.657944 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 16:26:39.657944 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 16:26:39.657944 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 16:26:39.658927 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 16:26:39.658927 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 16:26:39.658927 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 16:26:39.658927 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 16:26:39.658927 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:26:39.658927 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:26:39.658927 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:26:39.658927 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:26:39.658927 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:26:39.658927 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:26:39.658927 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:26:39.658927 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application with Lock( Aug 09 16:26:39.658927 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:26:39.658927 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:26:39.658927 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:26:39.658927 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:26:39.663077 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:26:39.663077 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:26:39.663077 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:26:39.663077 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:26:39.663077 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 16:26:39.663077 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 16:26:39.663077 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 16:26:39.663077 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 16:26:39.663077 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 16:26:39.663077 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 16:26:39.663077 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 09 16:26:39.663077 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Aug 09 16:26:39.663077 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 156/299] 10.222.0.104 () {56 vars in 1104 bytes} [Tue Aug 9 16:26:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 16:26:39.663077 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5c0594-3b82-4c7f-bcd4-e0c6ceb8dd55 None None] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:39.663804 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5c0594-3b82-4c7f-bcd4-e0c6ceb8dd55 None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:39.663804 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5c0594-3b82-4c7f-bcd4-e0c6ceb8dd55 None None] PATH_INFO: `/` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:39.663804 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 157/300] 10.222.0.104 () {54 vars in 932 bytes} [Tue Aug 9 16:26:39 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:26:39.665222 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5c0594-3b82-4c7f-bcd4-e0c6ceb8dd55 None None] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:39.737501 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b1ca21-40fe-4274-bc18-795143926247 None None] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:39.752087 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:39.782031 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdc3c7e-9f50-43b2-b8b6-211e8cddf3e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:39.782678 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdc3c7e-9f50-43b2-b8b6-211e8cddf3e4 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:39.782951 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdc3c7e-9f50-43b2-b8b6-211e8cddf3e4 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:39.783254 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdc3c7e-9f50-43b2-b8b6-211e8cddf3e4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:39.790509 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:39.795501 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdc3c7e-9f50-43b2-b8b6-211e8cddf3e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 16:26:39.797078 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5c0594-3b82-4c7f-bcd4-e0c6ceb8dd55 None None] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:39.800496 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application [None req-6bdc3c7e-9f50-43b2-b8b6-211e8cddf3e4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 09 16:26:39.800496 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:26:39.800496 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:26:39.800496 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:26:39.800496 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:26:39.800496 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:26:39.800496 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:26:39.800496 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:26:39.800496 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:26:39.800496 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:26:39.800496 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:26:39.800496 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:26:39.800496 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 16:26:39.800496 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 16:26:39.800496 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 16:26:39.800496 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 16:26:39.801366 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 16:26:39.801366 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 16:26:39.801366 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 16:26:39.801366 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 16:26:39.801366 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:26:39.801366 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:26:39.801366 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:26:39.801366 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:26:39.801366 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:26:39.801366 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:26:39.801366 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:26:39.801366 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application with Lock( Aug 09 16:26:39.801366 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:26:39.801366 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:26:39.801366 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:26:39.801366 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:26:39.802226 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:26:39.802226 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:26:39.802226 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:26:39.802226 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:26:39.802226 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 16:26:39.802226 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 16:26:39.802226 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 16:26:39.802226 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 16:26:39.802226 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 16:26:39.802226 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 16:26:39.802226 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 09 16:26:39.802226 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Aug 09 16:26:39.802226 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 144/301] 10.222.0.104 () {56 vars in 1104 bytes} [Tue Aug 9 16:26:39 2022] GET /identity/v3/roles/reader => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 16:26:39.807719 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd305e3-e929-477f-97be-40c8462883f9 None None] REQUEST_METHOD: `POST` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:39.808005 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd305e3-e929-477f-97be-40c8462883f9 None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:39.808275 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd305e3-e929-477f-97be-40c8462883f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:39.826752 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.auth.core [None req-5cd305e3-e929-477f-97be-40c8462883f9 None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:26:39.828488 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.fernet_utils [None req-5cd305e3-e929-477f-97be-40c8462883f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:26:39.835809 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1730634d-6b01-4e11-9f6f-2d42d34928dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:39.836486 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1730634d-6b01-4e11-9f6f-2d42d34928dc None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:39.836764 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1730634d-6b01-4e11-9f6f-2d42d34928dc None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:39.837036 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1730634d-6b01-4e11-9f6f-2d42d34928dc None admin] PATH_INFO: `/v3/roles` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:39.837775 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1730634d-6b01-4e11-9f6f-2d42d34928dc None admin] RBAC: Adding query filter params (name=member) {{(pid=87275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:26:39.838111 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1730634d-6b01-4e11-9f6f-2d42d34928dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:39.839484 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1730634d-6b01-4e11-9f6f-2d42d34928dc None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:39.852784 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 158/302] 10.222.0.104 () {56 vars in 1106 bytes} [Tue Aug 9 16:26:39 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:26:39.852784 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1730634d-6b01-4e11-9f6f-2d42d34928dc None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:39.901725 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 145/303] 10.222.0.104 () {58 vars in 1029 bytes} [Tue Aug 9 16:26:39 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 16:26:39.902519 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd305e3-e929-477f-97be-40c8462883f9 None None] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:39.961374 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1730634d-6b01-4e11-9f6f-2d42d34928dc None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:39.995215 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b103ede3-9e5a-4823-ad85-e3364eab1d44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:39.995819 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b103ede3-9e5a-4823-ad85-e3364eab1d44 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:39.996098 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b103ede3-9e5a-4823-ad85-e3364eab1d44 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:39.996372 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b103ede3-9e5a-4823-ad85-e3364eab1d44 None admin] PATH_INFO: `/v3/roles` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:39.997032 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b103ede3-9e5a-4823-ad85-e3364eab1d44 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:26:39.997338 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b103ede3-9e5a-4823-ad85-e3364eab1d44 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:39.998748 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b103ede3-9e5a-4823-ad85-e3364eab1d44 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:40.005642 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd305e3-e929-477f-97be-40c8462883f9 None None] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:40.006773 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 159/304] 10.222.0.104 () {56 vars in 1106 bytes} [Tue Aug 9 16:26:39 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:26:40.007363 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:40.007764 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16589a19-cdc2-47e9-b19e-f65c3a293041 None None] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:40.008743 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16589a19-cdc2-47e9-b19e-f65c3a293041 None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:40.008743 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16589a19-cdc2-47e9-b19e-f65c3a293041 None None] PATH_INFO: `/` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:40.009615 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 160/305] 10.222.0.104 () {54 vars in 932 bytes} [Tue Aug 9 16:26:40 2022] GET /identity => generated 271 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:26:40.014552 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16589a19-cdc2-47e9-b19e-f65c3a293041 None None] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:40.039765 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:40.042439 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33883a0-ce00-48b2-938b-924d70756309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:40.043067 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33883a0-ce00-48b2-938b-924d70756309 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:40.043340 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33883a0-ce00-48b2-938b-924d70756309 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:40.043605 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33883a0-ce00-48b2-938b-924d70756309 None admin] PATH_INFO: `/v3/users/568c5eaf072149a68d4b696c06669688` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:40.044759 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33883a0-ce00-48b2-938b-924d70756309 None admin] RBAC: Authorizing `identity:get_user(user_id=568c5eaf072149a68d4b696c06669688)` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:40.046212 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33883a0-ce00-48b2-938b-924d70756309 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:40.047792 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 146/306] 10.222.0.104 () {56 vars in 1182 bytes} [Tue Aug 9 16:26:39 2022] GET /identity/v3/users/568c5eaf072149a68d4b696c06669688 => generated 294 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:26:40.051568 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33883a0-ce00-48b2-938b-924d70756309 None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:40.117457 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16589a19-cdc2-47e9-b19e-f65c3a293041 None None] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:40.151301 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4604e1-1981-4332-9afa-ee589c30378f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:40.151981 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4604e1-1981-4332-9afa-ee589c30378f None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:40.152205 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4604e1-1981-4332-9afa-ee589c30378f None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:40.152484 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4604e1-1981-4332-9afa-ee589c30378f None admin] PATH_INFO: `/v3/domains/default` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:40.153591 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4604e1-1981-4332-9afa-ee589c30378f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:40.155144 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4604e1-1981-4332-9afa-ee589c30378f None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:40.155297 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33883a0-ce00-48b2-938b-924d70756309 None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:40.157278 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 161/307] 10.222.0.104 () {56 vars in 1113 bytes} [Tue Aug 9 16:26:40 2022] GET /identity/v3/domains/default => generated 200 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:26:40.158410 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2552cfb-897b-438c-ad2e-b747c3ee9514 None None] REQUEST_METHOD: `POST` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:40.158689 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2552cfb-897b-438c-ad2e-b747c3ee9514 None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:40.158960 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2552cfb-897b-438c-ad2e-b747c3ee9514 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:40.175953 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.auth.core [None req-e2552cfb-897b-438c-ad2e-b747c3ee9514 None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:26:40.177138 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.fernet_utils [None req-e2552cfb-897b-438c-ad2e-b747c3ee9514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:26:40.188986 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d292c6-6015-44e6-918f-f1e761fbc8bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:40.189603 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d292c6-6015-44e6-918f-f1e761fbc8bd None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:40.189878 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d292c6-6015-44e6-918f-f1e761fbc8bd None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:40.190201 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d292c6-6015-44e6-918f-f1e761fbc8bd None admin] PATH_INFO: `/v3/users/bf9fbde7a3fe4441933df4b1ace1a942` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:40.203932 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d292c6-6015-44e6-918f-f1e761fbc8bd None admin] RBAC: Authorizing `identity:get_user(user_id=bf9fbde7a3fe4441933df4b1ace1a942)` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:40.205354 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d292c6-6015-44e6-918f-f1e761fbc8bd None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:40.207112 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 147/308] 10.222.0.104 () {56 vars in 1182 bytes} [Tue Aug 9 16:26:40 2022] GET /identity/v3/users/bf9fbde7a3fe4441933df4b1ace1a942 => generated 294 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:26:40.207681 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d292c6-6015-44e6-918f-f1e761fbc8bd None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:40.234550 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:40.245845 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 162/309] 10.222.0.104 () {58 vars in 1029 bytes} [Tue Aug 9 16:26:40 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 16:26:40.246707 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2552cfb-897b-438c-ad2e-b747c3ee9514 None None] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:40.270839 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:40.314493 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d292c6-6015-44e6-918f-f1e761fbc8bd None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:40.347055 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2552cfb-897b-438c-ad2e-b747c3ee9514 None None] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:40.348482 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6a3165-8b9a-4089-81d1-f233064712b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:40.349123 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6a3165-8b9a-4089-81d1-f233064712b7 None admin] REQUEST_METHOD: `PUT` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:40.349401 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6a3165-8b9a-4089-81d1-f233064712b7 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:40.349671 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6a3165-8b9a-4089-81d1-f233064712b7 None admin] PATH_INFO: `/v3/system/users/568c5eaf072149a68d4b696c06669688/roles/044ca4f80141492b9c128ada543865e8` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:40.351098 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6a3165-8b9a-4089-81d1-f233064712b7 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=568c5eaf072149a68d4b696c06669688, role_id=044ca4f80141492b9c128ada543865e8)` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:40.352471 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6a3165-8b9a-4089-81d1-f233064712b7 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:40.361098 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 148/310] 10.222.0.104 () {58 vars in 1339 bytes} [Tue Aug 9 16:26:40 2022] PUT /identity/v3/system/users/568c5eaf072149a68d4b696c06669688/roles/044ca4f80141492b9c128ada543865e8 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 16:26:40.361942 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6a3165-8b9a-4089-81d1-f233064712b7 None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:40.396758 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9279e5e9-0fd4-4e4d-ac34-23ca4d5c0cc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:40.397403 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9279e5e9-0fd4-4e4d-ac34-23ca4d5c0cc0 None admin] REQUEST_METHOD: `POST` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:40.397685 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9279e5e9-0fd4-4e4d-ac34-23ca4d5c0cc0 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:40.397991 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9279e5e9-0fd4-4e4d-ac34-23ca4d5c0cc0 None admin] PATH_INFO: `/v3/groups` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:40.398673 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9279e5e9-0fd4-4e4d-ac34-23ca4d5c0cc0 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:40.400146 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9279e5e9-0fd4-4e4d-ac34-23ca4d5c0cc0 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:40.425961 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 163/311] 10.222.0.104 () {60 vars in 1139 bytes} [Tue Aug 9 16:26:40 2022] POST /identity/v3/groups => generated 230 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 16:26:40.425961 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9279e5e9-0fd4-4e4d-ac34-23ca4d5c0cc0 None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:40.497513 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:40.512384 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6a3165-8b9a-4089-81d1-f233064712b7 None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:40.540823 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:40.563475 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0958fe06-8c87-489a-b4a8-58b37271b376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:40.563694 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9279e5e9-0fd4-4e4d-ac34-23ca4d5c0cc0 None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:40.564098 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0958fe06-8c87-489a-b4a8-58b37271b376 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:40.564373 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0958fe06-8c87-489a-b4a8-58b37271b376 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:40.564642 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0958fe06-8c87-489a-b4a8-58b37271b376 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:40.565556 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0958fe06-8c87-489a-b4a8-58b37271b376 None admin] RBAC: Adding query filter params (role.id=92a80348b6cb4bb38f2a6a9f5facb705, user.id=bf9fbde7a3fe4441933df4b1ace1a942, scope.system=all) {{(pid=87276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:26:40.567157 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0958fe06-8c87-489a-b4a8-58b37271b376 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:40.568408 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0958fe06-8c87-489a-b4a8-58b37271b376 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:40.579001 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 149/312] 10.222.0.104 () {56 vars in 1313 bytes} [Tue Aug 9 16:26:40 2022] GET /identity/v3/role_assignments?user.id=bf9fbde7a3fe4441933df4b1ace1a942&scope.system=all&role.id=92a80348b6cb4bb38f2a6a9f5facb705 => generated 227 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:26:40.608052 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac86a05-9471-4ee2-b1fd-bd8a4c7a580e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:40.608713 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac86a05-9471-4ee2-b1fd-bd8a4c7a580e None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:40.609625 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac86a05-9471-4ee2-b1fd-bd8a4c7a580e None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:40.609869 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac86a05-9471-4ee2-b1fd-bd8a4c7a580e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:40.622430 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac86a05-9471-4ee2-b1fd-bd8a4c7a580e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 16:26:40.628554 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application [None req-0ac86a05-9471-4ee2-b1fd-bd8a4c7a580e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 09 16:26:40.628554 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:26:40.628554 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:26:40.628554 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:26:40.628554 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:26:40.628554 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:26:40.628554 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:26:40.628554 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:26:40.628554 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:26:40.628554 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:26:40.628554 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:26:40.628554 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:26:40.628554 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 16:26:40.628554 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 16:26:40.628554 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 16:26:40.628554 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 16:26:40.629535 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 16:26:40.629535 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 16:26:40.629535 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 16:26:40.629535 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 16:26:40.629535 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:26:40.629535 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:26:40.629535 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:26:40.629535 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:26:40.629535 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:26:40.629535 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:26:40.629535 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:26:40.629535 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application with Lock( Aug 09 16:26:40.629535 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:26:40.629535 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:26:40.629535 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:26:40.629535 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:26:40.630844 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:26:40.630844 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:26:40.630844 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:26:40.630844 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:26:40.630844 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 16:26:40.630844 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 16:26:40.630844 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 16:26:40.630844 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 16:26:40.630844 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 16:26:40.630844 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 16:26:40.630844 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 09 16:26:40.630844 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Aug 09 16:26:40.630844 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 164/313] 10.222.0.104 () {56 vars in 1104 bytes} [Tue Aug 9 16:26:40 2022] GET /identity/v3/roles/reader => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 16:26:40.636213 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0958fe06-8c87-489a-b4a8-58b37271b376 None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:40.755383 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0958fe06-8c87-489a-b4a8-58b37271b376 None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:40.792705 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97af8a7d-629a-43b0-a85b-8c06f97acacc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:40.793312 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97af8a7d-629a-43b0-a85b-8c06f97acacc None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:40.793586 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97af8a7d-629a-43b0-a85b-8c06f97acacc None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:40.793855 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97af8a7d-629a-43b0-a85b-8c06f97acacc None admin] PATH_INFO: `/v3/roles` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:40.794771 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97af8a7d-629a-43b0-a85b-8c06f97acacc None admin] RBAC: Adding query filter params (name=reader) {{(pid=87276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:26:40.795073 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97af8a7d-629a-43b0-a85b-8c06f97acacc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:40.796992 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97af8a7d-629a-43b0-a85b-8c06f97acacc None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:40.806002 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 150/314] 10.222.0.104 () {56 vars in 1106 bytes} [Tue Aug 9 16:26:40 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:26:40.811442 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac86a05-9471-4ee2-b1fd-bd8a4c7a580e None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:40.919499 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac86a05-9471-4ee2-b1fd-bd8a4c7a580e None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:40.956634 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcd770c-b6f9-45a5-a631-4e2361ef1e82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:40.957610 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcd770c-b6f9-45a5-a631-4e2361ef1e82 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:40.958138 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcd770c-b6f9-45a5-a631-4e2361ef1e82 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:40.958627 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcd770c-b6f9-45a5-a631-4e2361ef1e82 None admin] PATH_INFO: `/v3/users/9b64ccd33db24d06b2838afaaf7cf7c7` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:40.959982 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcd770c-b6f9-45a5-a631-4e2361ef1e82 None admin] RBAC: Authorizing `identity:get_user(user_id=9b64ccd33db24d06b2838afaaf7cf7c7)` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:40.961608 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcd770c-b6f9-45a5-a631-4e2361ef1e82 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:40.963754 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 165/315] 10.222.0.104 () {56 vars in 1182 bytes} [Tue Aug 9 16:26:40 2022] GET /identity/v3/users/9b64ccd33db24d06b2838afaaf7cf7c7 => generated 298 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:26:40.968922 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97af8a7d-629a-43b0-a85b-8c06f97acacc None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:40.990906 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:41.076701 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97af8a7d-629a-43b0-a85b-8c06f97acacc None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:41.115443 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214a09e0-0b9d-4d51-ad78-7b6a4ca63efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:41.116060 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214a09e0-0b9d-4d51-ad78-7b6a4ca63efe None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:41.116344 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214a09e0-0b9d-4d51-ad78-7b6a4ca63efe None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:41.116615 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214a09e0-0b9d-4d51-ad78-7b6a4ca63efe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:41.188639 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214a09e0-0b9d-4d51-ad78-7b6a4ca63efe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:41.190153 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214a09e0-0b9d-4d51-ad78-7b6a4ca63efe None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:41.208741 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:41.293259 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 151/316] 10.222.0.104 () {58 vars in 1287 bytes} [Tue Aug 9 16:26:40 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 16:26:41.299547 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcd770c-b6f9-45a5-a631-4e2361ef1e82 None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:41.312944 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:41.409330 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcd770c-b6f9-45a5-a631-4e2361ef1e82 None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:41.444594 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06bc104-1e10-4779-ac2b-8856cc84ea5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:41.445288 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06bc104-1e10-4779-ac2b-8856cc84ea5f None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:41.445572 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06bc104-1e10-4779-ac2b-8856cc84ea5f None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:41.445843 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06bc104-1e10-4779-ac2b-8856cc84ea5f None admin] PATH_INFO: `/v3/projects/01f42016635a4e7ab655700eadbb1d93` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:41.447067 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06bc104-1e10-4779-ac2b-8856cc84ea5f None admin] RBAC: Authorizing `identity:get_project(project_id=01f42016635a4e7ab655700eadbb1d93)` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:41.448505 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06bc104-1e10-4779-ac2b-8856cc84ea5f None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:41.450454 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 166/317] 10.222.0.104 () {56 vars in 1191 bytes} [Tue Aug 9 16:26:41 2022] GET /identity/v3/projects/01f42016635a4e7ab655700eadbb1d93 => generated 303 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:26:41.456889 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214a09e0-0b9d-4d51-ad78-7b6a4ca63efe None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:41.563846 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214a09e0-0b9d-4d51-ad78-7b6a4ca63efe None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:41.582908 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:41.601253 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ed9bef-91b7-4cd9-a9b1-d2bd6ce27990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:41.601863 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ed9bef-91b7-4cd9-a9b1-d2bd6ce27990 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:41.602194 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ed9bef-91b7-4cd9-a9b1-d2bd6ce27990 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:41.602465 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ed9bef-91b7-4cd9-a9b1-d2bd6ce27990 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:41.603186 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ed9bef-91b7-4cd9-a9b1-d2bd6ce27990 None admin] RBAC: Adding query filter params (role.id=92a80348b6cb4bb38f2a6a9f5facb705, scope.project.id=01f42016635a4e7ab655700eadbb1d93, user.id=9b64ccd33db24d06b2838afaaf7cf7c7) {{(pid=87276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:26:41.603492 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ed9bef-91b7-4cd9-a9b1-d2bd6ce27990 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:41.604918 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ed9bef-91b7-4cd9-a9b1-d2bd6ce27990 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:41.611250 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 152/318] 10.222.0.104 () {56 vars in 1379 bytes} [Tue Aug 9 16:26:41 2022] GET /identity/v3/role_assignments?user.id=9b64ccd33db24d06b2838afaaf7cf7c7&scope.project.id=01f42016635a4e7ab655700eadbb1d93&role.id=92a80348b6cb4bb38f2a6a9f5facb705 => generated 610 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:26:42.789138 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1cf4d3-9a3e-4934-bf8c-69387bf2d922 None None] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:42.789695 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1cf4d3-9a3e-4934-bf8c-69387bf2d922 None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:42.789695 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1cf4d3-9a3e-4934-bf8c-69387bf2d922 None None] PATH_INFO: `/` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:42.791166 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 167/319] 10.222.0.104 () {54 vars in 932 bytes} [Tue Aug 9 16:26:42 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:26:42.796664 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c477665-49af-4f67-8c4a-0ab7942fcf61 None None] REQUEST_METHOD: `POST` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:42.797380 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c477665-49af-4f67-8c4a-0ab7942fcf61 None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:42.797652 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c477665-49af-4f67-8c4a-0ab7942fcf61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:42.817068 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.auth.core [None req-9c477665-49af-4f67-8c4a-0ab7942fcf61 None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:26:42.818268 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.fernet_utils [None req-9c477665-49af-4f67-8c4a-0ab7942fcf61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:26:42.862154 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85678203-e9fa-4120-a4a3-0e4521cd1c13 None None] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:42.862477 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85678203-e9fa-4120-a4a3-0e4521cd1c13 None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:42.862696 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85678203-e9fa-4120-a4a3-0e4521cd1c13 None None] PATH_INFO: `/` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:42.864180 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 168/320] 10.222.0.104 () {54 vars in 932 bytes} [Tue Aug 9 16:26:42 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:26:42.868997 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed9c45f-bcd4-4ebc-b320-66249c2acddd None None] REQUEST_METHOD: `POST` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:42.869288 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed9c45f-bcd4-4ebc-b320-66249c2acddd None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:42.869552 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed9c45f-bcd4-4ebc-b320-66249c2acddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:42.889220 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.auth.core [None req-aed9c45f-bcd4-4ebc-b320-66249c2acddd None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:26:42.890980 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.fernet_utils [None req-aed9c45f-bcd4-4ebc-b320-66249c2acddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:26:42.894432 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 153/321] 10.222.0.104 () {58 vars in 1029 bytes} [Tue Aug 9 16:26:42 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 16:26:42.919757 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c477665-49af-4f67-8c4a-0ab7942fcf61 None None] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:42.969955 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 169/322] 10.222.0.104 () {58 vars in 1029 bytes} [Tue Aug 9 16:26:42 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 16:26:42.990580 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed9c45f-bcd4-4ebc-b320-66249c2acddd None None] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:43.000914 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:43.025787 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c477665-49af-4f67-8c4a-0ab7942fcf61 None None] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:43.040222 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:43.062415 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4570232f-ccba-4245-866f-332f34f7dd50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:43.063039 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4570232f-ccba-4245-866f-332f34f7dd50 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:43.063312 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4570232f-ccba-4245-866f-332f34f7dd50 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:43.063577 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4570232f-ccba-4245-866f-332f34f7dd50 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:43.073727 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4570232f-ccba-4245-866f-332f34f7dd50 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 16:26:43.078609 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application [None req-4570232f-ccba-4245-866f-332f34f7dd50 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 09 16:26:43.078609 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:26:43.078609 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:26:43.078609 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:26:43.078609 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:26:43.078609 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:26:43.078609 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:26:43.078609 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:26:43.078609 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:26:43.078609 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:26:43.078609 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:26:43.078609 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:26:43.078609 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 16:26:43.078609 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 16:26:43.078609 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 16:26:43.078609 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 16:26:43.079579 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 16:26:43.079579 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 16:26:43.079579 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 16:26:43.079579 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 16:26:43.079579 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:26:43.079579 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:26:43.079579 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:26:43.079579 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:26:43.079579 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:26:43.079579 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:26:43.079579 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:26:43.079579 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application with Lock( Aug 09 16:26:43.079579 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:26:43.079579 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:26:43.079579 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:26:43.079579 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:26:43.080410 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:26:43.080410 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:26:43.080410 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:26:43.080410 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:26:43.080410 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 16:26:43.080410 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 16:26:43.080410 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 16:26:43.080410 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 16:26:43.080410 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 16:26:43.080410 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 16:26:43.080410 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 09 16:26:43.080410 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Aug 09 16:26:43.080410 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 154/323] 10.222.0.104 () {56 vars in 1104 bytes} [Tue Aug 9 16:26:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 16:26:43.081099 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ecaa30-273c-4f2b-9060-c03824876d32 None None] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:43.081099 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ecaa30-273c-4f2b-9060-c03824876d32 None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:43.081706 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ecaa30-273c-4f2b-9060-c03824876d32 None None] PATH_INFO: `/` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:43.082710 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 155/324] 10.222.0.104 () {54 vars in 932 bytes} [Tue Aug 9 16:26:43 2022] GET /identity => generated 271 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:26:43.087245 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ecaa30-273c-4f2b-9060-c03824876d32 None None] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:43.094000 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed9c45f-bcd4-4ebc-b320-66249c2acddd None None] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:43.127783 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5e430e-d784-415c-a2b8-74f41821e8e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:43.128410 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5e430e-d784-415c-a2b8-74f41821e8e1 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:43.128686 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5e430e-d784-415c-a2b8-74f41821e8e1 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:43.128954 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5e430e-d784-415c-a2b8-74f41821e8e1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:43.130066 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5e430e-d784-415c-a2b8-74f41821e8e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:43.131502 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5e430e-d784-415c-a2b8-74f41821e8e1 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:43.133206 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 170/325] 10.222.0.104 () {56 vars in 1113 bytes} [Tue Aug 9 16:26:42 2022] GET /identity/v3/domains/default => generated 200 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 16:26:43.134346 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aacd019-6c22-4adb-80c5-3b63ea8b8885 None None] REQUEST_METHOD: `POST` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:43.134631 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aacd019-6c22-4adb-80c5-3b63ea8b8885 None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:43.134903 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aacd019-6c22-4adb-80c5-3b63ea8b8885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:43.152554 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.auth.core [None req-3aacd019-6c22-4adb-80c5-3b63ea8b8885 None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:26:43.153790 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.fernet_utils [None req-3aacd019-6c22-4adb-80c5-3b63ea8b8885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:26:43.192512 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ecaa30-273c-4f2b-9060-c03824876d32 None None] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:43.220626 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 171/326] 10.222.0.104 () {58 vars in 1029 bytes} [Tue Aug 9 16:26:43 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 16:26:43.221436 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aacd019-6c22-4adb-80c5-3b63ea8b8885 None None] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:43.228915 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:43.235904 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4532555b-f369-47da-b1d5-a86f2dd85062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:43.236510 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4532555b-f369-47da-b1d5-a86f2dd85062 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:43.236788 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4532555b-f369-47da-b1d5-a86f2dd85062 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:43.237060 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4532555b-f369-47da-b1d5-a86f2dd85062 None admin] PATH_INFO: `/v3/roles` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:43.237722 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4532555b-f369-47da-b1d5-a86f2dd85062 None admin] RBAC: Adding query filter params (name=member) {{(pid=87276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:26:43.238066 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4532555b-f369-47da-b1d5-a86f2dd85062 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:43.240226 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4532555b-f369-47da-b1d5-a86f2dd85062 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:43.249058 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 156/327] 10.222.0.104 () {56 vars in 1106 bytes} [Tue Aug 9 16:26:43 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:26:43.250420 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4532555b-f369-47da-b1d5-a86f2dd85062 None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:43.287750 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:43.324948 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aacd019-6c22-4adb-80c5-3b63ea8b8885 None None] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:43.353775 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4532555b-f369-47da-b1d5-a86f2dd85062 None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:43.357531 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b109917d-d17c-4e90-af82-e7babdb6cab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:43.358161 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b109917d-d17c-4e90-af82-e7babdb6cab7 None admin] REQUEST_METHOD: `POST` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:43.358442 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b109917d-d17c-4e90-af82-e7babdb6cab7 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:43.359244 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b109917d-d17c-4e90-af82-e7babdb6cab7 None admin] PATH_INFO: `/v3/groups` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:43.359852 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b109917d-d17c-4e90-af82-e7babdb6cab7 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:43.361285 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b109917d-d17c-4e90-af82-e7babdb6cab7 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:43.383814 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 172/328] 10.222.0.104 () {60 vars in 1139 bytes} [Tue Aug 9 16:26:43 2022] POST /identity/v3/groups => generated 227 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 16:26:43.383814 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b109917d-d17c-4e90-af82-e7babdb6cab7 None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:43.399847 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73cf513-0766-4c6c-bf25-2d3b929f29a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:43.400697 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73cf513-0766-4c6c-bf25-2d3b929f29a8 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:43.400964 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73cf513-0766-4c6c-bf25-2d3b929f29a8 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:43.401263 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73cf513-0766-4c6c-bf25-2d3b929f29a8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:43.415886 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73cf513-0766-4c6c-bf25-2d3b929f29a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 16:26:43.423632 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application [None req-c73cf513-0766-4c6c-bf25-2d3b929f29a8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 09 16:26:43.423632 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:26:43.423632 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:26:43.423632 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:26:43.423632 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:26:43.423632 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:26:43.423632 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:26:43.423632 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:26:43.423632 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:26:43.423632 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:26:43.423632 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:26:43.423632 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:26:43.423632 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 16:26:43.423632 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 16:26:43.423632 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 16:26:43.423632 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 16:26:43.424624 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 16:26:43.424624 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 16:26:43.424624 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 16:26:43.424624 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 16:26:43.424624 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:26:43.424624 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:26:43.424624 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:26:43.424624 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:26:43.424624 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:26:43.424624 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:26:43.424624 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:26:43.424624 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application with Lock( Aug 09 16:26:43.424624 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:26:43.424624 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:26:43.424624 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:26:43.424624 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:26:43.425444 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:26:43.425444 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:26:43.425444 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:26:43.425444 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:26:43.425444 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 16:26:43.425444 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 16:26:43.425444 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 16:26:43.425444 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 16:26:43.425444 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 16:26:43.425444 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 16:26:43.425444 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 09 16:26:43.425444 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Aug 09 16:26:43.426669 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 157/329] 10.222.0.104 () {56 vars in 1104 bytes} [Tue Aug 9 16:26:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 16:26:43.431658 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73cf513-0766-4c6c-bf25-2d3b929f29a8 None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:43.457788 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:43.500543 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b109917d-d17c-4e90-af82-e7babdb6cab7 None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:43.538842 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80097127-51ce-4ae7-b41b-8daf33107b0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:43.539395 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80097127-51ce-4ae7-b41b-8daf33107b0e None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:43.539671 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80097127-51ce-4ae7-b41b-8daf33107b0e None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:43.539942 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80097127-51ce-4ae7-b41b-8daf33107b0e None admin] PATH_INFO: `/v3/users/568c5eaf072149a68d4b696c06669688` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:43.540893 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:43.541119 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80097127-51ce-4ae7-b41b-8daf33107b0e None admin] RBAC: Authorizing `identity:get_user(user_id=568c5eaf072149a68d4b696c06669688)` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:43.543115 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80097127-51ce-4ae7-b41b-8daf33107b0e None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:43.549952 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 173/330] 10.222.0.104 () {56 vars in 1182 bytes} [Tue Aug 9 16:26:43 2022] GET /identity/v3/users/568c5eaf072149a68d4b696c06669688 => generated 294 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:26:43.551073 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80097127-51ce-4ae7-b41b-8daf33107b0e None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:43.554700 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73cf513-0766-4c6c-bf25-2d3b929f29a8 None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:43.593748 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569b7931-e244-4f3c-9a74-56ebf1cd297f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:43.594873 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569b7931-e244-4f3c-9a74-56ebf1cd297f None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:43.595143 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569b7931-e244-4f3c-9a74-56ebf1cd297f None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:43.595414 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569b7931-e244-4f3c-9a74-56ebf1cd297f None admin] PATH_INFO: `/v3/roles` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:43.596428 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569b7931-e244-4f3c-9a74-56ebf1cd297f None admin] RBAC: Adding query filter params (name=reader) {{(pid=87276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:26:43.596728 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569b7931-e244-4f3c-9a74-56ebf1cd297f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:43.598623 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569b7931-e244-4f3c-9a74-56ebf1cd297f None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:43.609946 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 158/331] 10.222.0.104 () {56 vars in 1106 bytes} [Tue Aug 9 16:26:43 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 16:26:43.615852 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569b7931-e244-4f3c-9a74-56ebf1cd297f None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:43.674950 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80097127-51ce-4ae7-b41b-8daf33107b0e None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:43.723834 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568fb57e-50a9-4315-bebb-b3967bc84813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:43.724453 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568fb57e-50a9-4315-bebb-b3967bc84813 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:43.724784 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568fb57e-50a9-4315-bebb-b3967bc84813 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:43.725051 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568fb57e-50a9-4315-bebb-b3967bc84813 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:43.725805 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568fb57e-50a9-4315-bebb-b3967bc84813 None admin] RBAC: Adding query filter params (role.id=044ca4f80141492b9c128ada543865e8, user.id=568c5eaf072149a68d4b696c06669688, scope.system=all) {{(pid=87275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:26:43.726142 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568fb57e-50a9-4315-bebb-b3967bc84813 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:43.727580 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568fb57e-50a9-4315-bebb-b3967bc84813 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:43.730258 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:43.743565 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 174/332] 10.222.0.104 () {56 vars in 1313 bytes} [Tue Aug 9 16:26:43 2022] GET /identity/v3/role_assignments?user.id=568c5eaf072149a68d4b696c06669688&scope.system=all&role.id=044ca4f80141492b9c128ada543865e8 => generated 512 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 16:26:43.755730 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569b7931-e244-4f3c-9a74-56ebf1cd297f None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:43.796511 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53268cd-07f4-440f-b94f-7194d57450e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:43.797097 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53268cd-07f4-440f-b94f-7194d57450e9 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:43.797633 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53268cd-07f4-440f-b94f-7194d57450e9 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:43.797633 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53268cd-07f4-440f-b94f-7194d57450e9 None admin] PATH_INFO: `/v3/users/bf9fbde7a3fe4441933df4b1ace1a942` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:43.798928 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53268cd-07f4-440f-b94f-7194d57450e9 None admin] RBAC: Authorizing `identity:get_user(user_id=bf9fbde7a3fe4441933df4b1ace1a942)` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:43.800384 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53268cd-07f4-440f-b94f-7194d57450e9 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:43.802343 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 159/333] 10.222.0.104 () {56 vars in 1182 bytes} [Tue Aug 9 16:26:43 2022] GET /identity/v3/users/bf9fbde7a3fe4441933df4b1ace1a942 => generated 294 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 16:26:43.807764 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568fb57e-50a9-4315-bebb-b3967bc84813 None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:43.924522 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568fb57e-50a9-4315-bebb-b3967bc84813 None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:43.966078 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62be3d0e-bd0a-4079-b63a-2aaabd4866c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:43.966736 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62be3d0e-bd0a-4079-b63a-2aaabd4866c3 None admin] REQUEST_METHOD: `PUT` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:43.967008 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62be3d0e-bd0a-4079-b63a-2aaabd4866c3 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:43.967276 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62be3d0e-bd0a-4079-b63a-2aaabd4866c3 None admin] PATH_INFO: `/v3/system/users/bf9fbde7a3fe4441933df4b1ace1a942/roles/92a80348b6cb4bb38f2a6a9f5facb705` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:43.968742 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62be3d0e-bd0a-4079-b63a-2aaabd4866c3 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=bf9fbde7a3fe4441933df4b1ace1a942, role_id=92a80348b6cb4bb38f2a6a9f5facb705)` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:43.970155 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62be3d0e-bd0a-4079-b63a-2aaabd4866c3 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:43.982893 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 175/334] 10.222.0.104 () {58 vars in 1339 bytes} [Tue Aug 9 16:26:43 2022] PUT /identity/v3/system/users/bf9fbde7a3fe4441933df4b1ace1a942/roles/92a80348b6cb4bb38f2a6a9f5facb705 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 16:26:45.959682 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d9a1aa-568d-4635-a6da-ed74b3a91ada None None] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:45.960209 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d9a1aa-568d-4635-a6da-ed74b3a91ada None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:45.960209 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d9a1aa-568d-4635-a6da-ed74b3a91ada None None] PATH_INFO: `/` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:45.961776 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 160/335] 10.222.0.104 () {54 vars in 932 bytes} [Tue Aug 9 16:26:45 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:26:45.967012 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58728ba3-22c0-41f0-b252-d2c133d05618 None None] REQUEST_METHOD: `POST` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:45.967445 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58728ba3-22c0-41f0-b252-d2c133d05618 None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:45.967708 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58728ba3-22c0-41f0-b252-d2c133d05618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:45.994205 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.auth.core [None req-58728ba3-22c0-41f0-b252-d2c133d05618 None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:26:45.995394 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.fernet_utils [None req-58728ba3-22c0-41f0-b252-d2c133d05618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:26:46.054329 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:46.074596 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 176/336] 10.222.0.104 () {58 vars in 1029 bytes} [Tue Aug 9 16:26:45 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 16:26:46.116148 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d9a1aa-568d-4635-a6da-ed74b3a91ada None None] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:46.147120 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:46.243415 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d9a1aa-568d-4635-a6da-ed74b3a91ada None None] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:46.292107 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed22cb4c-bcd1-4107-8ca0-5a8a2b9d3e44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:46.292764 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed22cb4c-bcd1-4107-8ca0-5a8a2b9d3e44 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:46.293038 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed22cb4c-bcd1-4107-8ca0-5a8a2b9d3e44 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:46.293305 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed22cb4c-bcd1-4107-8ca0-5a8a2b9d3e44 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:46.309099 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed22cb4c-bcd1-4107-8ca0-5a8a2b9d3e44 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 16:26:46.314655 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application [None req-ed22cb4c-bcd1-4107-8ca0-5a8a2b9d3e44 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 09 16:26:46.314655 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:26:46.314655 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:26:46.314655 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:26:46.314655 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:26:46.314655 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:26:46.314655 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:26:46.314655 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:26:46.314655 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:26:46.314655 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:26:46.314655 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:26:46.314655 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:26:46.314655 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 16:26:46.314655 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 16:26:46.314655 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 16:26:46.314655 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 16:26:46.315567 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 16:26:46.315567 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 16:26:46.315567 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 16:26:46.315567 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 16:26:46.315567 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:26:46.315567 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:26:46.315567 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:26:46.315567 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:26:46.315567 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:26:46.315567 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:26:46.315567 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:26:46.315567 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application with Lock( Aug 09 16:26:46.315567 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:26:46.315567 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:26:46.315567 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:26:46.315567 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:26:46.316346 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:26:46.316346 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:26:46.316346 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:26:46.316346 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:26:46.316346 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 16:26:46.316346 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 16:26:46.316346 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 16:26:46.316346 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 16:26:46.316346 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 16:26:46.316346 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 16:26:46.316346 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 09 16:26:46.316346 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Aug 09 16:26:46.316346 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 161/337] 10.222.0.104 () {56 vars in 1104 bytes} [Tue Aug 9 16:26:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 16:26:46.324225 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58728ba3-22c0-41f0-b252-d2c133d05618 None None] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:46.471264 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58728ba3-22c0-41f0-b252-d2c133d05618 None None] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:46.514136 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d00c58-f168-452f-ad56-3b7ae8c8b4e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:46.514816 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d00c58-f168-452f-ad56-3b7ae8c8b4e5 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:46.515096 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d00c58-f168-452f-ad56-3b7ae8c8b4e5 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:46.515364 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d00c58-f168-452f-ad56-3b7ae8c8b4e5 None admin] PATH_INFO: `/v3/roles` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:46.516033 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d00c58-f168-452f-ad56-3b7ae8c8b4e5 None admin] RBAC: Adding query filter params (name=member) {{(pid=87275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:26:46.516335 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d00c58-f168-452f-ad56-3b7ae8c8b4e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:46.517712 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d00c58-f168-452f-ad56-3b7ae8c8b4e5 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:46.531826 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 177/338] 10.222.0.104 () {56 vars in 1106 bytes} [Tue Aug 9 16:26:46 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:26:46.537386 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed22cb4c-bcd1-4107-8ca0-5a8a2b9d3e44 None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:46.637727 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:46.657375 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed22cb4c-bcd1-4107-8ca0-5a8a2b9d3e44 None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:46.703910 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184fff0e-2f08-4450-a8f4-f9c18192c9bb None None] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:46.704385 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184fff0e-2f08-4450-a8f4-f9c18192c9bb None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:46.704878 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184fff0e-2f08-4450-a8f4-f9c18192c9bb None None] PATH_INFO: `/` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:46.707382 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 178/339] 10.222.0.104 () {54 vars in 932 bytes} [Tue Aug 9 16:26:46 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:26:46.712437 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728c7cb0-550f-4fb5-ad3b-c0c351bfefb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:46.712723 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6effafe-e002-4bf6-ae15-ed514512413f None None] REQUEST_METHOD: `POST` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:46.713008 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6effafe-e002-4bf6-ae15-ed514512413f None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:46.713111 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728c7cb0-550f-4fb5-ad3b-c0c351bfefb4 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:46.713289 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6effafe-e002-4bf6-ae15-ed514512413f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:46.713382 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728c7cb0-550f-4fb5-ad3b-c0c351bfefb4 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:46.713582 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728c7cb0-550f-4fb5-ad3b-c0c351bfefb4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:46.760320 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.auth.core [None req-a6effafe-e002-4bf6-ae15-ed514512413f None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:26:46.762668 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.fernet_utils [None req-a6effafe-e002-4bf6-ae15-ed514512413f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:26:46.836578 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728c7cb0-550f-4fb5-ad3b-c0c351bfefb4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:46.838110 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728c7cb0-550f-4fb5-ad3b-c0c351bfefb4 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:46.842240 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:46.890450 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 179/340] 10.222.0.104 () {58 vars in 1029 bytes} [Tue Aug 9 16:26:46 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 16:26:46.937773 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6effafe-e002-4bf6-ae15-ed514512413f None None] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:46.970084 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:47.002334 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 162/341] 10.222.0.104 () {58 vars in 1287 bytes} [Tue Aug 9 16:26:46 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 16:26:47.008130 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728c7cb0-550f-4fb5-ad3b-c0c351bfefb4 None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:47.150670 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6effafe-e002-4bf6-ae15-ed514512413f None None] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:47.206374 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728c7cb0-550f-4fb5-ad3b-c0c351bfefb4 None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:47.215399 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55cfccc-f29c-4d5c-9891-d24919c85aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:47.216048 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55cfccc-f29c-4d5c-9891-d24919c85aa6 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:47.216324 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55cfccc-f29c-4d5c-9891-d24919c85aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:47.216596 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55cfccc-f29c-4d5c-9891-d24919c85aa6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:47.243478 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55cfccc-f29c-4d5c-9891-d24919c85aa6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 16:26:47.250416 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application [None req-b55cfccc-f29c-4d5c-9891-d24919c85aa6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 16:26:47.250416 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:26:47.250416 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:26:47.250416 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:26:47.250416 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:26:47.250416 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:26:47.250416 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:26:47.250416 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:26:47.250416 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:26:47.250416 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:26:47.250416 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:26:47.250416 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:26:47.250416 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 16:26:47.250416 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 16:26:47.250416 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 16:26:47.250416 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 16:26:47.251304 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 16:26:47.251304 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 16:26:47.251304 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 16:26:47.251304 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 16:26:47.251304 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:26:47.251304 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:26:47.251304 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:26:47.251304 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:26:47.251304 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:26:47.251304 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:26:47.251304 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:26:47.251304 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application with Lock( Aug 09 16:26:47.251304 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:26:47.251304 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:26:47.251304 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:26:47.251304 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:26:47.252095 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:26:47.252095 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:26:47.252095 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:26:47.252095 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:26:47.252095 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 16:26:47.252095 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 16:26:47.252095 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 16:26:47.252095 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 16:26:47.252095 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 16:26:47.252095 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 16:26:47.252095 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 16:26:47.252095 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Aug 09 16:26:47.259981 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 180/342] 10.222.0.104 () {56 vars in 1119 bytes} [Tue Aug 9 16:26:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 16:26:47.273957 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf6b811-982c-48ce-99e3-b8dc046f5b61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:47.275001 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf6b811-982c-48ce-99e3-b8dc046f5b61 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:47.275514 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf6b811-982c-48ce-99e3-b8dc046f5b61 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:47.275988 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf6b811-982c-48ce-99e3-b8dc046f5b61 None admin] PATH_INFO: `/v3/projects/8e08184221014bc3bf771cdbe24c6720` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:47.282021 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55cfccc-f29c-4d5c-9891-d24919c85aa6 None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:47.287708 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf6b811-982c-48ce-99e3-b8dc046f5b61 None admin] RBAC: Authorizing `identity:get_project(project_id=8e08184221014bc3bf771cdbe24c6720)` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:47.296758 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf6b811-982c-48ce-99e3-b8dc046f5b61 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:47.300778 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 163/343] 10.222.0.104 () {56 vars in 1191 bytes} [Tue Aug 9 16:26:47 2022] GET /identity/v3/projects/8e08184221014bc3bf771cdbe24c6720 => generated 299 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 16:26:47.306707 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf6b811-982c-48ce-99e3-b8dc046f5b61 None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:47.338363 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:47.408192 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:47.485097 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf6b811-982c-48ce-99e3-b8dc046f5b61 None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:47.511834 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55cfccc-f29c-4d5c-9891-d24919c85aa6 None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:47.550709 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115f154a-dfe4-46bd-926c-969b3a839bae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:47.551385 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115f154a-dfe4-46bd-926c-969b3a839bae None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:47.551665 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115f154a-dfe4-46bd-926c-969b3a839bae None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:47.551944 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115f154a-dfe4-46bd-926c-969b3a839bae None admin] PATH_INFO: `/v3/groups/3d825bb1f13649789718ba4a111c99b0` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:47.566672 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115f154a-dfe4-46bd-926c-969b3a839bae None admin] RBAC: Authorizing `identity:get_group(group_id=3d825bb1f13649789718ba4a111c99b0)` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:47.568177 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115f154a-dfe4-46bd-926c-969b3a839bae None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:47.570247 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 164/344] 10.222.0.104 () {56 vars in 1185 bytes} [Tue Aug 9 16:26:47 2022] GET /identity/v3/groups/3d825bb1f13649789718ba4a111c99b0 => generated 227 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 16:26:47.576103 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115f154a-dfe4-46bd-926c-969b3a839bae None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:47.602627 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c7909f-c214-4f3f-8769-d6655708f018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:47.603256 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c7909f-c214-4f3f-8769-d6655708f018 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:47.603531 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c7909f-c214-4f3f-8769-d6655708f018 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:47.603799 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c7909f-c214-4f3f-8769-d6655708f018 None admin] PATH_INFO: `/v3/roles` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:47.604469 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c7909f-c214-4f3f-8769-d6655708f018 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:26:47.604769 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c7909f-c214-4f3f-8769-d6655708f018 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:47.606265 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c7909f-c214-4f3f-8769-d6655708f018 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:47.624192 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 181/345] 10.222.0.104 () {56 vars in 1116 bytes} [Tue Aug 9 16:26:47 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 16:26:47.629948 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c7909f-c214-4f3f-8769-d6655708f018 None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:47.724947 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115f154a-dfe4-46bd-926c-969b3a839bae None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:47.748015 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:47.758276 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:47.760713 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c7909f-c214-4f3f-8769-d6655708f018 None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:47.790917 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f558ed6-7161-44e2-8a1f-110559f77b6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:47.791552 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f558ed6-7161-44e2-8a1f-110559f77b6c None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:47.791833 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f558ed6-7161-44e2-8a1f-110559f77b6c None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:47.792107 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f558ed6-7161-44e2-8a1f-110559f77b6c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:47.792868 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f558ed6-7161-44e2-8a1f-110559f77b6c None admin] RBAC: Adding query filter params (group.id=3d825bb1f13649789718ba4a111c99b0, role.id=044ca4f80141492b9c128ada543865e8, scope.project.id=8e08184221014bc3bf771cdbe24c6720) {{(pid=87276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:26:47.793200 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f558ed6-7161-44e2-8a1f-110559f77b6c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:47.796392 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f558ed6-7161-44e2-8a1f-110559f77b6c None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:47.808024 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 165/346] 10.222.0.104 () {56 vars in 1381 bytes} [Tue Aug 9 16:26:47 2022] GET /identity/v3/role_assignments?group.id=3d825bb1f13649789718ba4a111c99b0&scope.project.id=8e08184221014bc3bf771cdbe24c6720&role.id=044ca4f80141492b9c128ada543865e8 => generated 261 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:26:47.811827 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786f4048-3f56-4c3b-a813-04b694dffdbb None None] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:47.812116 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786f4048-3f56-4c3b-a813-04b694dffdbb None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:47.812390 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786f4048-3f56-4c3b-a813-04b694dffdbb None None] PATH_INFO: `/` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:47.814886 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 166/347] 10.222.0.104 () {54 vars in 932 bytes} [Tue Aug 9 16:26:47 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:26:47.821159 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adcda21-1c9d-4fab-802f-a0eba929d84f None None] REQUEST_METHOD: `POST` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:47.821586 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adcda21-1c9d-4fab-802f-a0eba929d84f None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:47.821986 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adcda21-1c9d-4fab-802f-a0eba929d84f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:47.839760 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f8f5ff-30e6-4bb7-9540-e7d2df021d44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:47.840400 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f8f5ff-30e6-4bb7-9540-e7d2df021d44 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:47.840900 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f8f5ff-30e6-4bb7-9540-e7d2df021d44 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:47.841178 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f8f5ff-30e6-4bb7-9540-e7d2df021d44 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:47.863070 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.auth.core [None req-1adcda21-1c9d-4fab-802f-a0eba929d84f None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:26:47.864309 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.fernet_utils [None req-1adcda21-1c9d-4fab-802f-a0eba929d84f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:26:47.933700 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f8f5ff-30e6-4bb7-9540-e7d2df021d44 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:47.935322 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f8f5ff-30e6-4bb7-9540-e7d2df021d44 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:48.019957 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 167/348] 10.222.0.104 () {58 vars in 1029 bytes} [Tue Aug 9 16:26:47 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 16:26:48.023542 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29c40d1-e75b-4a76-8b17-a45ca0e22ae3 None None] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:48.023819 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29c40d1-e75b-4a76-8b17-a45ca0e22ae3 None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:48.024093 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29c40d1-e75b-4a76-8b17-a45ca0e22ae3 None None] PATH_INFO: `/` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:48.028083 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 168/349] 10.222.0.104 () {54 vars in 932 bytes} [Tue Aug 9 16:26:48 2022] GET /identity => generated 271 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:26:48.033832 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c624215-5015-472f-a847-5516d0be5f21 None None] REQUEST_METHOD: `POST` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:48.034193 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c624215-5015-472f-a847-5516d0be5f21 None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:48.034406 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c624215-5015-472f-a847-5516d0be5f21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:48.068467 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.auth.core [None req-8c624215-5015-472f-a847-5516d0be5f21 None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:26:48.070537 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.fernet_utils [None req-8c624215-5015-472f-a847-5516d0be5f21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:26:48.127774 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 182/350] 10.222.0.104 () {58 vars in 1287 bytes} [Tue Aug 9 16:26:47 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 498 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 09 16:26:48.128700 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f8f5ff-30e6-4bb7-9540-e7d2df021d44 None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:48.132862 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:48.218699 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 169/351] 10.222.0.104 () {58 vars in 1029 bytes} [Tue Aug 9 16:26:48 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 16:26:48.219574 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c624215-5015-472f-a847-5516d0be5f21 None None] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:48.247499 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f8f5ff-30e6-4bb7-9540-e7d2df021d44 None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:48.266108 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:48.303922 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73854a6-17b0-4dc0-a738-f7f258bc0f11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:48.304479 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73854a6-17b0-4dc0-a738-f7f258bc0f11 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:48.304761 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73854a6-17b0-4dc0-a738-f7f258bc0f11 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:48.305034 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73854a6-17b0-4dc0-a738-f7f258bc0f11 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:48.316430 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73854a6-17b0-4dc0-a738-f7f258bc0f11 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 16:26:48.322392 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application [None req-e73854a6-17b0-4dc0-a738-f7f258bc0f11 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 09 16:26:48.322392 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:26:48.322392 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:26:48.322392 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:26:48.322392 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:26:48.322392 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:26:48.322392 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:26:48.322392 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:26:48.322392 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:26:48.322392 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:26:48.322392 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:26:48.322392 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:26:48.322392 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 16:26:48.322392 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 16:26:48.322392 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 16:26:48.322392 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 16:26:48.323317 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 16:26:48.323317 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 16:26:48.323317 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 16:26:48.323317 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 16:26:48.323317 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:26:48.323317 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:26:48.323317 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:26:48.323317 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:26:48.323317 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:26:48.323317 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:26:48.323317 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:26:48.323317 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application with Lock( Aug 09 16:26:48.323317 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:26:48.323317 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:26:48.323317 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:26:48.323317 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:26:48.324568 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:26:48.324568 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:26:48.324568 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:26:48.324568 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:26:48.324568 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 16:26:48.324568 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 16:26:48.324568 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 16:26:48.324568 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 16:26:48.324568 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 16:26:48.324568 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 16:26:48.324568 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 09 16:26:48.324568 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Aug 09 16:26:48.324568 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 183/352] 10.222.0.104 () {56 vars in 1104 bytes} [Tue Aug 9 16:26:48 2022] GET /identity/v3/roles/reader => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 16:26:48.325300 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efbb487-925f-4aa2-82a2-c37b099fc2b3 None None] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:48.325369 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efbb487-925f-4aa2-82a2-c37b099fc2b3 None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:48.325707 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efbb487-925f-4aa2-82a2-c37b099fc2b3 None None] PATH_INFO: `/` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:48.331296 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 184/353] 10.222.0.104 () {54 vars in 932 bytes} [Tue Aug 9 16:26:48 2022] GET /identity => generated 271 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:26:48.332056 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efbb487-925f-4aa2-82a2-c37b099fc2b3 None None] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:48.335052 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c624215-5015-472f-a847-5516d0be5f21 None None] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:48.373303 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c892c7-e5c1-4bb6-a7f1-fa85a8bd229a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:48.377164 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c892c7-e5c1-4bb6-a7f1-fa85a8bd229a None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:48.377164 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c892c7-e5c1-4bb6-a7f1-fa85a8bd229a None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:48.377164 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c892c7-e5c1-4bb6-a7f1-fa85a8bd229a None admin] PATH_INFO: `/v3/projects/8e08184221014bc3bf771cdbe24c6720` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:48.377164 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c892c7-e5c1-4bb6-a7f1-fa85a8bd229a None admin] RBAC: Authorizing `identity:get_project(project_id=8e08184221014bc3bf771cdbe24c6720)` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:48.377164 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c892c7-e5c1-4bb6-a7f1-fa85a8bd229a None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:48.379136 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 170/354] 10.222.0.104 () {56 vars in 1191 bytes} [Tue Aug 9 16:26:48 2022] GET /identity/v3/projects/8e08184221014bc3bf771cdbe24c6720 => generated 299 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:26:48.380458 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755419ed-80ce-48eb-a940-52b6dc313262 None None] REQUEST_METHOD: `POST` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:48.380730 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755419ed-80ce-48eb-a940-52b6dc313262 None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:48.380972 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755419ed-80ce-48eb-a940-52b6dc313262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:48.401001 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.auth.core [None req-755419ed-80ce-48eb-a940-52b6dc313262 None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:26:48.402240 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.fernet_utils [None req-755419ed-80ce-48eb-a940-52b6dc313262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:26:48.410269 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:48.452582 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efbb487-925f-4aa2-82a2-c37b099fc2b3 None None] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:48.477414 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 171/355] 10.222.0.104 () {58 vars in 1029 bytes} [Tue Aug 9 16:26:48 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 16:26:48.478430 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755419ed-80ce-48eb-a940-52b6dc313262 None None] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:48.509163 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aa854b-5068-4a98-91e0-32213c5ca0e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:48.510243 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aa854b-5068-4a98-91e0-32213c5ca0e4 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:48.511443 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aa854b-5068-4a98-91e0-32213c5ca0e4 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:48.511795 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aa854b-5068-4a98-91e0-32213c5ca0e4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:48.525859 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:48.532071 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49aa854b-5068-4a98-91e0-32213c5ca0e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 16:26:48.538144 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application [None req-49aa854b-5068-4a98-91e0-32213c5ca0e4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 09 16:26:48.538144 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:26:48.538144 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:26:48.538144 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:26:48.538144 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:26:48.538144 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:26:48.538144 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:26:48.538144 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:26:48.538144 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:26:48.538144 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:26:48.538144 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:26:48.538144 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:26:48.538144 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 16:26:48.538144 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 16:26:48.538144 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 16:26:48.538144 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 16:26:48.539035 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 16:26:48.539035 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 16:26:48.539035 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 16:26:48.539035 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 16:26:48.539035 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:26:48.539035 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:26:48.539035 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:26:48.539035 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:26:48.539035 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:26:48.539035 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:26:48.539035 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:26:48.539035 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application with Lock( Aug 09 16:26:48.539035 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:26:48.539035 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:26:48.539035 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:26:48.539035 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:26:48.539807 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:26:48.539807 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:26:48.539807 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:26:48.539807 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:26:48.539807 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 16:26:48.539807 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 16:26:48.539807 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 16:26:48.539807 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 16:26:48.539807 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 16:26:48.539807 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 16:26:48.539807 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 09 16:26:48.539807 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Aug 09 16:26:48.546425 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 185/356] 10.222.0.104 () {56 vars in 1104 bytes} [Tue Aug 9 16:26:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 16:26:48.547523 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aa854b-5068-4a98-91e0-32213c5ca0e4 None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:48.604630 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755419ed-80ce-48eb-a940-52b6dc313262 None None] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:48.649671 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83870a39-1c62-45a6-8209-3f2daca27df5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:48.650303 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83870a39-1c62-45a6-8209-3f2daca27df5 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:48.650583 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83870a39-1c62-45a6-8209-3f2daca27df5 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:48.650854 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83870a39-1c62-45a6-8209-3f2daca27df5 None admin] PATH_INFO: `/v3/roles` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:48.651512 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83870a39-1c62-45a6-8209-3f2daca27df5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:26:48.651821 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83870a39-1c62-45a6-8209-3f2daca27df5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:48.653200 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83870a39-1c62-45a6-8209-3f2daca27df5 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:48.664249 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 172/357] 10.222.0.104 () {56 vars in 1106 bytes} [Tue Aug 9 16:26:48 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:26:48.664710 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83870a39-1c62-45a6-8209-3f2daca27df5 None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:48.701343 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aa854b-5068-4a98-91e0-32213c5ca0e4 None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:48.725506 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:48.744929 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9d83d3-6eab-46f0-a259-ce45c0b79d1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:48.745574 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9d83d3-6eab-46f0-a259-ce45c0b79d1d None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:48.745852 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9d83d3-6eab-46f0-a259-ce45c0b79d1d None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:48.746167 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9d83d3-6eab-46f0-a259-ce45c0b79d1d None admin] PATH_INFO: `/v3/groups/3d825bb1f13649789718ba4a111c99b0` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:48.747455 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9d83d3-6eab-46f0-a259-ce45c0b79d1d None admin] RBAC: Authorizing `identity:get_group(group_id=3d825bb1f13649789718ba4a111c99b0)` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:48.748922 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9d83d3-6eab-46f0-a259-ce45c0b79d1d None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:48.750854 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 186/358] 10.222.0.104 () {56 vars in 1185 bytes} [Tue Aug 9 16:26:48 2022] GET /identity/v3/groups/3d825bb1f13649789718ba4a111c99b0 => generated 227 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:26:48.752013 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb10151-0899-49ac-b9d6-fdf89f150e7c None None] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:48.752289 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb10151-0899-49ac-b9d6-fdf89f150e7c None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:48.752556 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb10151-0899-49ac-b9d6-fdf89f150e7c None None] PATH_INFO: `/` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:48.753997 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 187/359] 10.222.0.104 () {54 vars in 932 bytes} [Tue Aug 9 16:26:48 2022] GET /identity => generated 271 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:26:48.754702 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb10151-0899-49ac-b9d6-fdf89f150e7c None None] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:48.803835 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:48.807939 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83870a39-1c62-45a6-8209-3f2daca27df5 None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:48.849383 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a626ca-5de0-4560-bc07-1c9d992c9934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:48.850395 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a626ca-5de0-4560-bc07-1c9d992c9934 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:48.850873 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a626ca-5de0-4560-bc07-1c9d992c9934 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:48.851356 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a626ca-5de0-4560-bc07-1c9d992c9934 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:48.862528 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a626ca-5de0-4560-bc07-1c9d992c9934 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 16:26:48.867729 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application [None req-41a626ca-5de0-4560-bc07-1c9d992c9934 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 16:26:48.867729 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:26:48.867729 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:26:48.867729 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:26:48.867729 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:26:48.867729 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:26:48.867729 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:26:48.867729 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:26:48.867729 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:26:48.867729 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:26:48.867729 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:26:48.867729 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:26:48.867729 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 16:26:48.867729 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 16:26:48.867729 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 16:26:48.867729 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 16:26:48.868728 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 16:26:48.868728 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 16:26:48.868728 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 16:26:48.868728 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 16:26:48.868728 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:26:48.868728 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:26:48.868728 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:26:48.868728 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:26:48.868728 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:26:48.868728 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:26:48.868728 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:26:48.868728 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application with Lock( Aug 09 16:26:48.868728 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:26:48.868728 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:26:48.868728 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:26:48.868728 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:26:48.869557 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:26:48.869557 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:26:48.869557 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:26:48.869557 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:26:48.869557 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 16:26:48.869557 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 16:26:48.869557 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 16:26:48.869557 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 16:26:48.869557 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 16:26:48.869557 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 16:26:48.869557 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 16:26:48.869557 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Aug 09 16:26:48.869557 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 173/360] 10.222.0.104 () {56 vars in 1119 bytes} [Tue Aug 9 16:26:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 16:26:48.870364 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a626ca-5de0-4560-bc07-1c9d992c9934 None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:48.895383 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb10151-0899-49ac-b9d6-fdf89f150e7c None None] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:48.945190 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5205f4a-7d17-4297-8439-a0cb40f25c14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:48.946430 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5205f4a-7d17-4297-8439-a0cb40f25c14 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:48.946985 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5205f4a-7d17-4297-8439-a0cb40f25c14 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:48.947570 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5205f4a-7d17-4297-8439-a0cb40f25c14 None admin] PATH_INFO: `/v3/roles` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:48.949028 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5205f4a-7d17-4297-8439-a0cb40f25c14 None admin] RBAC: Adding query filter params (name=member) {{(pid=87275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:26:48.949334 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5205f4a-7d17-4297-8439-a0cb40f25c14 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:48.950772 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5205f4a-7d17-4297-8439-a0cb40f25c14 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:48.964697 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 188/361] 10.222.0.104 () {56 vars in 1106 bytes} [Tue Aug 9 16:26:48 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:26:48.968576 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b4d8db-be1e-4fc4-b8cc-a052c9841498 None None] REQUEST_METHOD: `POST` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:48.968862 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b4d8db-be1e-4fc4-b8cc-a052c9841498 None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:48.969135 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b4d8db-be1e-4fc4-b8cc-a052c9841498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:48.989687 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a626ca-5de0-4560-bc07-1c9d992c9934 None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:48.991710 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.auth.core [None req-d7b4d8db-be1e-4fc4-b8cc-a052c9841498 None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:26:48.991710 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.fernet_utils [None req-d7b4d8db-be1e-4fc4-b8cc-a052c9841498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:26:49.032886 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e6d718-91a3-4ca5-b420-d7a8df598618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:49.035215 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e6d718-91a3-4ca5-b420-d7a8df598618 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:49.035516 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e6d718-91a3-4ca5-b420-d7a8df598618 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:49.035793 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e6d718-91a3-4ca5-b420-d7a8df598618 None admin] PATH_INFO: `/v3/users/bf9fbde7a3fe4441933df4b1ace1a942` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:49.036989 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e6d718-91a3-4ca5-b420-d7a8df598618 None admin] RBAC: Authorizing `identity:get_user(user_id=bf9fbde7a3fe4441933df4b1ace1a942)` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:49.038976 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e6d718-91a3-4ca5-b420-d7a8df598618 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:49.040844 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 174/362] 10.222.0.104 () {56 vars in 1182 bytes} [Tue Aug 9 16:26:48 2022] GET /identity/v3/users/bf9fbde7a3fe4441933df4b1ace1a942 => generated 294 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:26:49.045935 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e6d718-91a3-4ca5-b420-d7a8df598618 None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:49.047594 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:49.074170 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 189/363] 10.222.0.104 () {58 vars in 1029 bytes} [Tue Aug 9 16:26:48 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 16:26:49.075138 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b4d8db-be1e-4fc4-b8cc-a052c9841498 None None] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:49.079228 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:49.185528 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e6d718-91a3-4ca5-b420-d7a8df598618 None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:49.209678 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b4d8db-be1e-4fc4-b8cc-a052c9841498 None None] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:49.227736 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c90632-4f40-42b0-9cba-60780aec4c3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:49.228855 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c90632-4f40-42b0-9cba-60780aec4c3d None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:49.229336 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c90632-4f40-42b0-9cba-60780aec4c3d None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:49.231128 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c90632-4f40-42b0-9cba-60780aec4c3d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:49.232082 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c90632-4f40-42b0-9cba-60780aec4c3d None admin] RBAC: Adding query filter params (group.id=3d825bb1f13649789718ba4a111c99b0, role.id=8a954d5b81f74df1985780d968ff3073, scope.project.id=8e08184221014bc3bf771cdbe24c6720) {{(pid=87276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:26:49.232618 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c90632-4f40-42b0-9cba-60780aec4c3d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:49.235393 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c90632-4f40-42b0-9cba-60780aec4c3d None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:49.242423 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 175/364] 10.222.0.104 () {56 vars in 1381 bytes} [Tue Aug 9 16:26:49 2022] GET /identity/v3/role_assignments?group.id=3d825bb1f13649789718ba4a111c99b0&scope.project.id=8e08184221014bc3bf771cdbe24c6720&role.id=8a954d5b81f74df1985780d968ff3073 => generated 261 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:26:49.243355 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c90632-4f40-42b0-9cba-60780aec4c3d None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:49.250184 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f223f0-c49a-4fc2-b5c3-01abb0d68342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:49.250859 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f223f0-c49a-4fc2-b5c3-01abb0d68342 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:49.251134 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f223f0-c49a-4fc2-b5c3-01abb0d68342 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:49.251397 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f223f0-c49a-4fc2-b5c3-01abb0d68342 None admin] PATH_INFO: `/v3/roles` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:49.252111 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f223f0-c49a-4fc2-b5c3-01abb0d68342 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:26:49.252414 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f223f0-c49a-4fc2-b5c3-01abb0d68342 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:49.254023 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f223f0-c49a-4fc2-b5c3-01abb0d68342 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:49.264380 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 190/365] 10.222.0.104 () {56 vars in 1116 bytes} [Tue Aug 9 16:26:49 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:26:49.265386 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f223f0-c49a-4fc2-b5c3-01abb0d68342 None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:49.326312 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:49.373088 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:49.386014 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c90632-4f40-42b0-9cba-60780aec4c3d None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:49.403323 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f223f0-c49a-4fc2-b5c3-01abb0d68342 None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:49.433513 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb7d732-14b0-496f-bf2c-fb5d3cb29172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:49.434524 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb7d732-14b0-496f-bf2c-fb5d3cb29172 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:49.435115 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb7d732-14b0-496f-bf2c-fb5d3cb29172 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:49.436046 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb7d732-14b0-496f-bf2c-fb5d3cb29172 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:49.448996 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f46c90-c6b7-486e-afdc-7965200361f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:49.449625 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f46c90-c6b7-486e-afdc-7965200361f1 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:49.450004 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f46c90-c6b7-486e-afdc-7965200361f1 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:49.450290 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f46c90-c6b7-486e-afdc-7965200361f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:49.451053 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f46c90-c6b7-486e-afdc-7965200361f1 None admin] RBAC: Adding query filter params (role.id=92a80348b6cb4bb38f2a6a9f5facb705, user.id=bf9fbde7a3fe4441933df4b1ace1a942, scope.system=all) {{(pid=87275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:26:49.451368 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f46c90-c6b7-486e-afdc-7965200361f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:49.453048 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f46c90-c6b7-486e-afdc-7965200361f1 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:49.470133 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 191/366] 10.222.0.104 () {56 vars in 1313 bytes} [Tue Aug 9 16:26:49 2022] GET /identity/v3/role_assignments?user.id=bf9fbde7a3fe4441933df4b1ace1a942&scope.system=all&role.id=92a80348b6cb4bb38f2a6a9f5facb705 => generated 512 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:26:49.471132 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f46c90-c6b7-486e-afdc-7965200361f1 None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:49.524330 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb7d732-14b0-496f-bf2c-fb5d3cb29172 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:49.526235 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb7d732-14b0-496f-bf2c-fb5d3cb29172 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:49.597727 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:49.601690 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f46c90-c6b7-486e-afdc-7965200361f1 None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:49.638362 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:49.644636 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fc2e98-65d2-4ab5-9f6e-7eb16f6097f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:49.644636 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fc2e98-65d2-4ab5-9f6e-7eb16f6097f5 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:49.644916 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fc2e98-65d2-4ab5-9f6e-7eb16f6097f5 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:49.644985 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fc2e98-65d2-4ab5-9f6e-7eb16f6097f5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:49.649893 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 176/367] 10.222.0.104 () {58 vars in 1287 bytes} [Tue Aug 9 16:26:49 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 16:26:49.651216 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb7d732-14b0-496f-bf2c-fb5d3cb29172 None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:49.658688 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fc2e98-65d2-4ab5-9f6e-7eb16f6097f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 16:26:49.665636 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application [None req-48fc2e98-65d2-4ab5-9f6e-7eb16f6097f5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 16:26:49.665636 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:26:49.665636 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:26:49.665636 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:26:49.665636 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:26:49.665636 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:26:49.665636 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:26:49.665636 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:26:49.665636 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:26:49.665636 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:26:49.665636 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:26:49.665636 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:26:49.665636 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 16:26:49.665636 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 16:26:49.665636 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 16:26:49.665636 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 16:26:49.666658 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 16:26:49.666658 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 16:26:49.666658 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 16:26:49.666658 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 16:26:49.666658 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:26:49.666658 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:26:49.666658 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:26:49.666658 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:26:49.666658 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:26:49.666658 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:26:49.666658 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:26:49.666658 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application with Lock( Aug 09 16:26:49.666658 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:26:49.666658 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:26:49.666658 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:26:49.666658 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:26:49.667449 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:26:49.667449 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:26:49.667449 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:26:49.667449 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:26:49.667449 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 16:26:49.667449 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 16:26:49.667449 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 16:26:49.667449 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 16:26:49.667449 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 16:26:49.667449 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 16:26:49.667449 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 16:26:49.667449 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Aug 09 16:26:49.667449 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 192/368] 10.222.0.104 () {56 vars in 1101 bytes} [Tue Aug 9 16:26:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 16:26:49.668882 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fc2e98-65d2-4ab5-9f6e-7eb16f6097f5 None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:49.790995 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb7d732-14b0-496f-bf2c-fb5d3cb29172 None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:49.803064 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fc2e98-65d2-4ab5-9f6e-7eb16f6097f5 None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:49.829404 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328fba8b-074c-4201-8b64-020ddaf50de6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:49.830422 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328fba8b-074c-4201-8b64-020ddaf50de6 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:49.830928 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328fba8b-074c-4201-8b64-020ddaf50de6 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:49.831388 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328fba8b-074c-4201-8b64-020ddaf50de6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:49.841682 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41939d81-28ac-4fe9-b5e3-76b63e41f4c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:49.842926 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41939d81-28ac-4fe9-b5e3-76b63e41f4c3 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:49.843206 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41939d81-28ac-4fe9-b5e3-76b63e41f4c3 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:49.843485 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41939d81-28ac-4fe9-b5e3-76b63e41f4c3 None admin] PATH_INFO: `/v3/projects/01f42016635a4e7ab655700eadbb1d93` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:49.845894 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41939d81-28ac-4fe9-b5e3-76b63e41f4c3 None admin] RBAC: Authorizing `identity:get_project(project_id=01f42016635a4e7ab655700eadbb1d93)` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:49.847493 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41939d81-28ac-4fe9-b5e3-76b63e41f4c3 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:49.849539 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 193/369] 10.222.0.104 () {56 vars in 1191 bytes} [Tue Aug 9 16:26:49 2022] GET /identity/v3/projects/01f42016635a4e7ab655700eadbb1d93 => generated 303 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:26:49.853927 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41939d81-28ac-4fe9-b5e3-76b63e41f4c3 None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:49.882019 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:49.906284 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:49.914613 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328fba8b-074c-4201-8b64-020ddaf50de6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:49.916389 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328fba8b-074c-4201-8b64-020ddaf50de6 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:49.965300 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41939d81-28ac-4fe9-b5e3-76b63e41f4c3 None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:50.008093 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66164e5-8d8e-4a80-8ebf-03bca717eccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:50.008714 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66164e5-8d8e-4a80-8ebf-03bca717eccf None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:50.009038 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66164e5-8d8e-4a80-8ebf-03bca717eccf None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:50.009267 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66164e5-8d8e-4a80-8ebf-03bca717eccf None admin] PATH_INFO: `/v3/roles` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:50.009978 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66164e5-8d8e-4a80-8ebf-03bca717eccf None admin] RBAC: Adding query filter params (name=admin) {{(pid=87275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:26:50.010291 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66164e5-8d8e-4a80-8ebf-03bca717eccf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:50.011678 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66164e5-8d8e-4a80-8ebf-03bca717eccf None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:50.022022 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 194/370] 10.222.0.104 () {56 vars in 1104 bytes} [Tue Aug 9 16:26:49 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:26:50.026982 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66164e5-8d8e-4a80-8ebf-03bca717eccf None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:50.031440 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 177/371] 10.222.0.104 () {58 vars in 1287 bytes} [Tue Aug 9 16:26:49 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 16:26:50.033050 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328fba8b-074c-4201-8b64-020ddaf50de6 None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:50.132400 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:50.144869 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66164e5-8d8e-4a80-8ebf-03bca717eccf None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:50.146259 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:50.158967 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328fba8b-074c-4201-8b64-020ddaf50de6 None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:50.185482 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87491d51-bc7f-4bba-a3b2-0fa19ade6720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:50.186206 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87491d51-bc7f-4bba-a3b2-0fa19ade6720 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:50.186486 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87491d51-bc7f-4bba-a3b2-0fa19ade6720 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:50.186762 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87491d51-bc7f-4bba-a3b2-0fa19ade6720 None admin] PATH_INFO: `/v3/groups/3d825bb1f13649789718ba4a111c99b0` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:50.188004 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87491d51-bc7f-4bba-a3b2-0fa19ade6720 None admin] RBAC: Authorizing `identity:get_group(group_id=3d825bb1f13649789718ba4a111c99b0)` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:50.189456 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87491d51-bc7f-4bba-a3b2-0fa19ade6720 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:50.191245 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 195/372] 10.222.0.104 () {56 vars in 1185 bytes} [Tue Aug 9 16:26:50 2022] GET /identity/v3/groups/3d825bb1f13649789718ba4a111c99b0 => generated 227 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:26:50.191843 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87491d51-bc7f-4bba-a3b2-0fa19ade6720 None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:50.205158 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404aa1f4-1a77-4638-a287-790db8834a5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:50.206206 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404aa1f4-1a77-4638-a287-790db8834a5c None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:50.206689 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404aa1f4-1a77-4638-a287-790db8834a5c None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:50.207176 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404aa1f4-1a77-4638-a287-790db8834a5c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:50.306167 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404aa1f4-1a77-4638-a287-790db8834a5c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:50.307842 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404aa1f4-1a77-4638-a287-790db8834a5c None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:50.319238 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87491d51-bc7f-4bba-a3b2-0fa19ade6720 None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:50.365348 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ffe72d-f9fa-4097-b850-59bf5c839c0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:50.365934 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ffe72d-f9fa-4097-b850-59bf5c839c0a None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:50.366315 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ffe72d-f9fa-4097-b850-59bf5c839c0a None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:50.366694 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ffe72d-f9fa-4097-b850-59bf5c839c0a None admin] PATH_INFO: `/v3/projects/01f42016635a4e7ab655700eadbb1d93` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:50.368025 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ffe72d-f9fa-4097-b850-59bf5c839c0a None admin] RBAC: Authorizing `identity:get_project(project_id=01f42016635a4e7ab655700eadbb1d93)` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:50.369577 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ffe72d-f9fa-4097-b850-59bf5c839c0a None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:50.371806 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 196/373] 10.222.0.104 () {56 vars in 1191 bytes} [Tue Aug 9 16:26:50 2022] GET /identity/v3/projects/01f42016635a4e7ab655700eadbb1d93 => generated 303 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:26:50.375776 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ffe72d-f9fa-4097-b850-59bf5c839c0a None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:50.407994 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:50.452594 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:50.467788 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 178/374] 10.222.0.104 () {58 vars in 1287 bytes} [Tue Aug 9 16:26:50 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 16:26:50.468844 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404aa1f4-1a77-4638-a287-790db8834a5c None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:50.515605 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ffe72d-f9fa-4097-b850-59bf5c839c0a None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:50.567958 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff076063-f789-4085-87f4-8c039930e361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:50.567958 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff076063-f789-4085-87f4-8c039930e361 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:50.567958 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff076063-f789-4085-87f4-8c039930e361 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:50.567958 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff076063-f789-4085-87f4-8c039930e361 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:50.568555 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff076063-f789-4085-87f4-8c039930e361 None admin] RBAC: Adding query filter params (group.id=3d825bb1f13649789718ba4a111c99b0, role.id=044ca4f80141492b9c128ada543865e8, scope.project.id=01f42016635a4e7ab655700eadbb1d93) {{(pid=87275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:26:50.568838 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff076063-f789-4085-87f4-8c039930e361 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:50.570842 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff076063-f789-4085-87f4-8c039930e361 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:50.579657 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 197/375] 10.222.0.104 () {56 vars in 1381 bytes} [Tue Aug 9 16:26:50 2022] GET /identity/v3/role_assignments?group.id=3d825bb1f13649789718ba4a111c99b0&scope.project.id=01f42016635a4e7ab655700eadbb1d93&role.id=044ca4f80141492b9c128ada543865e8 => generated 261 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:26:50.581036 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff076063-f789-4085-87f4-8c039930e361 None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:50.602808 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404aa1f4-1a77-4638-a287-790db8834a5c None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:50.642555 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b40b81-8efe-4011-8eee-240e5fc2b974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:50.643580 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b40b81-8efe-4011-8eee-240e5fc2b974 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:50.644063 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b40b81-8efe-4011-8eee-240e5fc2b974 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:50.644531 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b40b81-8efe-4011-8eee-240e5fc2b974 None admin] PATH_INFO: `/v3/groups/3d825bb1f13649789718ba4a111c99b0` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:50.646010 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b40b81-8efe-4011-8eee-240e5fc2b974 None admin] RBAC: Authorizing `identity:get_group(group_id=3d825bb1f13649789718ba4a111c99b0)` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:50.647709 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b40b81-8efe-4011-8eee-240e5fc2b974 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:50.649999 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 179/376] 10.222.0.104 () {56 vars in 1185 bytes} [Tue Aug 9 16:26:50 2022] GET /identity/v3/groups/3d825bb1f13649789718ba4a111c99b0 => generated 227 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:26:50.651569 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5340f99-6ef7-4876-a87b-efba410421a3 None None] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:50.652047 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5340f99-6ef7-4876-a87b-efba410421a3 None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:50.652536 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5340f99-6ef7-4876-a87b-efba410421a3 None None] PATH_INFO: `/` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:50.653958 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 180/377] 10.222.0.104 () {54 vars in 932 bytes} [Tue Aug 9 16:26:50 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:26:50.658937 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5340f99-6ef7-4876-a87b-efba410421a3 None None] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:50.694291 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:50.706647 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff076063-f789-4085-87f4-8c039930e361 None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:50.730004 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:50.749505 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6e7677-6112-4d2d-980a-cf4cd831163f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:50.750210 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6e7677-6112-4d2d-980a-cf4cd831163f None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:50.750494 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6e7677-6112-4d2d-980a-cf4cd831163f None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:50.750770 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6e7677-6112-4d2d-980a-cf4cd831163f None admin] PATH_INFO: `/v3/projects/7ce95c8faa1d4165b111ca9c55852804` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:50.752006 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6e7677-6112-4d2d-980a-cf4cd831163f None admin] RBAC: Authorizing `identity:get_project(project_id=7ce95c8faa1d4165b111ca9c55852804)` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:50.753498 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6e7677-6112-4d2d-980a-cf4cd831163f None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:50.755242 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 198/378] 10.222.0.104 () {56 vars in 1191 bytes} [Tue Aug 9 16:26:50 2022] GET /identity/v3/projects/7ce95c8faa1d4165b111ca9c55852804 => generated 345 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:26:50.761133 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdbb958-b67b-4d93-8a74-7d10ff5d6488 None None] REQUEST_METHOD: `POST` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:50.761439 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdbb958-b67b-4d93-8a74-7d10ff5d6488 None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:50.761690 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdbb958-b67b-4d93-8a74-7d10ff5d6488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:50.781986 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.auth.core [None req-fbdbb958-b67b-4d93-8a74-7d10ff5d6488 None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:26:50.782852 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5340f99-6ef7-4876-a87b-efba410421a3 None None] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:50.783212 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.fernet_utils [None req-fbdbb958-b67b-4d93-8a74-7d10ff5d6488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:26:50.823355 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86da74d-0b93-4959-8c0b-f8edfaf77b49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:50.823914 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86da74d-0b93-4959-8c0b-f8edfaf77b49 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:50.824164 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86da74d-0b93-4959-8c0b-f8edfaf77b49 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:50.824449 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86da74d-0b93-4959-8c0b-f8edfaf77b49 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:50.825163 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86da74d-0b93-4959-8c0b-f8edfaf77b49 None admin] RBAC: Adding query filter params (group.id=3d825bb1f13649789718ba4a111c99b0, role.id=8a954d5b81f74df1985780d968ff3073, scope.project.id=01f42016635a4e7ab655700eadbb1d93) {{(pid=87276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:26:50.825469 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86da74d-0b93-4959-8c0b-f8edfaf77b49 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:50.828025 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86da74d-0b93-4959-8c0b-f8edfaf77b49 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:50.835478 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 181/379] 10.222.0.104 () {56 vars in 1381 bytes} [Tue Aug 9 16:26:50 2022] GET /identity/v3/role_assignments?group.id=3d825bb1f13649789718ba4a111c99b0&scope.project.id=01f42016635a4e7ab655700eadbb1d93&role.id=8a954d5b81f74df1985780d968ff3073 => generated 261 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:26:50.836430 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86da74d-0b93-4959-8c0b-f8edfaf77b49 None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:50.861370 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 199/380] 10.222.0.104 () {58 vars in 1029 bytes} [Tue Aug 9 16:26:50 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 16:26:50.886810 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdbb958-b67b-4d93-8a74-7d10ff5d6488 None None] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:50.995294 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86da74d-0b93-4959-8c0b-f8edfaf77b49 None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:51.030701 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:51.051831 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:51.058850 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdbb958-b67b-4d93-8a74-7d10ff5d6488 None None] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:51.071924 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ae61fc-f634-4582-9011-3d015795dc0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:51.072566 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ae61fc-f634-4582-9011-3d015795dc0d None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:51.072848 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ae61fc-f634-4582-9011-3d015795dc0d None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:51.073124 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ae61fc-f634-4582-9011-3d015795dc0d None admin] PATH_INFO: `/v3/groups/00196bcbfe984dcdaf75768d99d04259` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:51.083871 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ae61fc-f634-4582-9011-3d015795dc0d None admin] RBAC: Authorizing `identity:get_group(group_id=00196bcbfe984dcdaf75768d99d04259)` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:51.085543 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ae61fc-f634-4582-9011-3d015795dc0d None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:51.094305 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 182/381] 10.222.0.104 () {56 vars in 1185 bytes} [Tue Aug 9 16:26:50 2022] GET /identity/v3/groups/00196bcbfe984dcdaf75768d99d04259 => generated 230 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:26:51.097774 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ae61fc-f634-4582-9011-3d015795dc0d None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:51.133267 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bfbe47-cd0d-44c6-904f-75f3ced822c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:51.134027 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bfbe47-cd0d-44c6-904f-75f3ced822c8 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:51.134311 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bfbe47-cd0d-44c6-904f-75f3ced822c8 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:51.134584 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bfbe47-cd0d-44c6-904f-75f3ced822c8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:51.155381 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bfbe47-cd0d-44c6-904f-75f3ced822c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 16:26:51.161584 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application [None req-f8bfbe47-cd0d-44c6-904f-75f3ced822c8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 09 16:26:51.161584 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:26:51.161584 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:26:51.161584 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:26:51.161584 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:26:51.161584 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:26:51.161584 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:26:51.161584 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:26:51.161584 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:26:51.161584 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:26:51.161584 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:26:51.161584 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:26:51.161584 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 16:26:51.161584 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 16:26:51.161584 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 16:26:51.161584 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 16:26:51.162479 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 16:26:51.162479 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 16:26:51.162479 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 16:26:51.162479 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 16:26:51.162479 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:26:51.162479 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:26:51.162479 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:26:51.162479 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:26:51.162479 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:26:51.162479 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:26:51.162479 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:26:51.162479 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application with Lock( Aug 09 16:26:51.162479 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:26:51.162479 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:26:51.162479 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:26:51.162479 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:26:51.163266 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:26:51.163266 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:26:51.163266 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:26:51.163266 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:26:51.163266 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 16:26:51.163266 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 16:26:51.163266 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 16:26:51.163266 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 16:26:51.163266 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 16:26:51.163266 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 16:26:51.163266 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 09 16:26:51.163266 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Aug 09 16:26:51.163266 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 200/382] 10.222.0.104 () {56 vars in 1104 bytes} [Tue Aug 9 16:26:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 16:26:51.171227 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bfbe47-cd0d-44c6-904f-75f3ced822c8 None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:51.300114 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bfbe47-cd0d-44c6-904f-75f3ced822c8 None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:51.305076 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ae61fc-f634-4582-9011-3d015795dc0d None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:51.344136 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5c931d-f2e6-4f90-b628-ea9f960581eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:51.344749 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5c931d-f2e6-4f90-b628-ea9f960581eb None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:51.344942 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5c931d-f2e6-4f90-b628-ea9f960581eb None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:51.345208 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5c931d-f2e6-4f90-b628-ea9f960581eb None admin] PATH_INFO: `/v3/roles` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:51.345878 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5c931d-f2e6-4f90-b628-ea9f960581eb None admin] RBAC: Adding query filter params (name=member) {{(pid=87275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:26:51.346217 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5c931d-f2e6-4f90-b628-ea9f960581eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:51.347782 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5c931d-f2e6-4f90-b628-ea9f960581eb None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:51.349767 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d028760a-f0e2-4ad0-9106-f0d3b7de6632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:51.350738 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d028760a-f0e2-4ad0-9106-f0d3b7de6632 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:51.351260 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d028760a-f0e2-4ad0-9106-f0d3b7de6632 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:51.351718 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d028760a-f0e2-4ad0-9106-f0d3b7de6632 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:51.352697 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d028760a-f0e2-4ad0-9106-f0d3b7de6632 None admin] RBAC: Adding query filter params (group.id=00196bcbfe984dcdaf75768d99d04259, role.id=c0143e35c1344a39a931bbb6bcd5acdc, scope.project.id=7ce95c8faa1d4165b111ca9c55852804) {{(pid=87276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:26:51.353212 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d028760a-f0e2-4ad0-9106-f0d3b7de6632 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:51.354910 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d028760a-f0e2-4ad0-9106-f0d3b7de6632 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:51.362239 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 183/383] 10.222.0.104 () {56 vars in 1381 bytes} [Tue Aug 9 16:26:51 2022] GET /identity/v3/role_assignments?group.id=00196bcbfe984dcdaf75768d99d04259&scope.project.id=7ce95c8faa1d4165b111ca9c55852804&role.id=c0143e35c1344a39a931bbb6bcd5acdc => generated 261 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:26:51.365099 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 201/384] 10.222.0.104 () {56 vars in 1106 bytes} [Tue Aug 9 16:26:51 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:26:51.375100 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d028760a-f0e2-4ad0-9106-f0d3b7de6632 None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:51.470027 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:51.534981 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d028760a-f0e2-4ad0-9106-f0d3b7de6632 None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:51.591638 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da98f33d-2d69-4380-8216-6ca0915cd102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:51.592829 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da98f33d-2d69-4380-8216-6ca0915cd102 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:51.593112 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da98f33d-2d69-4380-8216-6ca0915cd102 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:51.593383 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da98f33d-2d69-4380-8216-6ca0915cd102 None admin] PATH_INFO: `/v3/groups/3d825bb1f13649789718ba4a111c99b0` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:51.594713 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da98f33d-2d69-4380-8216-6ca0915cd102 None admin] RBAC: Authorizing `identity:get_group(group_id=3d825bb1f13649789718ba4a111c99b0)` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:51.596182 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da98f33d-2d69-4380-8216-6ca0915cd102 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:51.598099 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 184/385] 10.222.0.104 () {56 vars in 1185 bytes} [Tue Aug 9 16:26:51 2022] GET /identity/v3/groups/3d825bb1f13649789718ba4a111c99b0 => generated 227 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:26:51.603325 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5c931d-f2e6-4f90-b628-ea9f960581eb None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:51.622115 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:51.760482 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5c931d-f2e6-4f90-b628-ea9f960581eb None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:51.824052 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c58a011-e856-41c7-9be4-436c3cdfa6f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:51.824771 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c58a011-e856-41c7-9be4-436c3cdfa6f7 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:51.825049 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c58a011-e856-41c7-9be4-436c3cdfa6f7 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:51.825996 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c58a011-e856-41c7-9be4-436c3cdfa6f7 None admin] PATH_INFO: `/v3/projects/8e08184221014bc3bf771cdbe24c6720` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:51.827997 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c58a011-e856-41c7-9be4-436c3cdfa6f7 None admin] RBAC: Authorizing `identity:get_project(project_id=8e08184221014bc3bf771cdbe24c6720)` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:51.829480 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c58a011-e856-41c7-9be4-436c3cdfa6f7 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:51.831577 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 202/386] 10.222.0.104 () {56 vars in 1191 bytes} [Tue Aug 9 16:26:51 2022] GET /identity/v3/projects/8e08184221014bc3bf771cdbe24c6720 => generated 299 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:26:51.836926 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da98f33d-2d69-4380-8216-6ca0915cd102 None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:51.997038 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da98f33d-2d69-4380-8216-6ca0915cd102 None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:52.023185 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:52.044721 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dc35bf-ef27-495e-b813-7a0db2929c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:52.044721 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dc35bf-ef27-495e-b813-7a0db2929c81 None admin] REQUEST_METHOD: `PUT` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:52.044721 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dc35bf-ef27-495e-b813-7a0db2929c81 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:52.044721 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dc35bf-ef27-495e-b813-7a0db2929c81 None admin] PATH_INFO: `/v3/projects/8e08184221014bc3bf771cdbe24c6720/groups/3d825bb1f13649789718ba4a111c99b0/roles/044ca4f80141492b9c128ada543865e8` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:52.046114 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dc35bf-ef27-495e-b813-7a0db2929c81 None admin] RBAC: Authorizing `identity:create_grant(project_id=8e08184221014bc3bf771cdbe24c6720, group_id=3d825bb1f13649789718ba4a111c99b0, role_id=044ca4f80141492b9c128ada543865e8)` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:52.047591 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dc35bf-ef27-495e-b813-7a0db2929c81 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:52.063869 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 185/387] 10.222.0.104 () {58 vars in 1447 bytes} [Tue Aug 9 16:26:51 2022] PUT /identity/v3/projects/8e08184221014bc3bf771cdbe24c6720/groups/3d825bb1f13649789718ba4a111c99b0/roles/044ca4f80141492b9c128ada543865e8 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 16:26:52.767470 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24451a8-0aca-470f-8c84-19cdc4e49d95 None None] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:52.768278 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24451a8-0aca-470f-8c84-19cdc4e49d95 None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:52.768748 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24451a8-0aca-470f-8c84-19cdc4e49d95 None None] PATH_INFO: `/` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:52.770577 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 203/388] 10.222.0.104 () {54 vars in 932 bytes} [Tue Aug 9 16:26:52 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:26:52.776415 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0555dc2a-94db-4b53-af82-779057448c53 None None] REQUEST_METHOD: `POST` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:52.776942 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0555dc2a-94db-4b53-af82-779057448c53 None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:52.777438 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0555dc2a-94db-4b53-af82-779057448c53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:52.807446 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.auth.core [None req-0555dc2a-94db-4b53-af82-779057448c53 None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:26:52.809057 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.fernet_utils [None req-0555dc2a-94db-4b53-af82-779057448c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:26:52.898520 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 186/389] 10.222.0.104 () {58 vars in 1029 bytes} [Tue Aug 9 16:26:52 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 16:26:52.930960 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24451a8-0aca-470f-8c84-19cdc4e49d95 None None] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:53.047869 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:53.079637 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24451a8-0aca-470f-8c84-19cdc4e49d95 None None] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:53.121809 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533e49fd-7de5-4100-bc4e-a03f74cee23c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:53.122496 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533e49fd-7de5-4100-bc4e-a03f74cee23c None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:53.122775 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533e49fd-7de5-4100-bc4e-a03f74cee23c None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:53.123572 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533e49fd-7de5-4100-bc4e-a03f74cee23c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:53.146783 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533e49fd-7de5-4100-bc4e-a03f74cee23c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 16:26:53.151612 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application [None req-533e49fd-7de5-4100-bc4e-a03f74cee23c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 16:26:53.151612 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:26:53.151612 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:26:53.151612 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:26:53.151612 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:26:53.151612 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:26:53.151612 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:26:53.151612 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:26:53.151612 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:26:53.151612 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:26:53.151612 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:26:53.151612 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:26:53.151612 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 16:26:53.151612 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 16:26:53.151612 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 16:26:53.151612 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 16:26:53.152595 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 16:26:53.152595 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 16:26:53.152595 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 16:26:53.152595 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 16:26:53.152595 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:26:53.152595 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:26:53.152595 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:26:53.152595 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:26:53.152595 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:26:53.152595 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:26:53.152595 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:26:53.152595 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application with Lock( Aug 09 16:26:53.152595 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:26:53.152595 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:26:53.152595 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:26:53.152595 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:26:53.153418 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:26:53.153418 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:26:53.153418 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:26:53.153418 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:26:53.153418 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 16:26:53.153418 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 16:26:53.153418 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 16:26:53.153418 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 16:26:53.153418 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 16:26:53.153418 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 16:26:53.153418 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 16:26:53.153418 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Aug 09 16:26:53.154087 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 204/390] 10.222.0.104 () {56 vars in 1119 bytes} [Tue Aug 9 16:26:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 16:26:53.159348 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0555dc2a-94db-4b53-af82-779057448c53 None None] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:53.312388 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0555dc2a-94db-4b53-af82-779057448c53 None None] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:53.324023 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:53.359318 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd73c7b1-90e7-41ca-9e6d-328aeb3d43b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:53.359945 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd73c7b1-90e7-41ca-9e6d-328aeb3d43b7 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:53.360224 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd73c7b1-90e7-41ca-9e6d-328aeb3d43b7 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:53.360498 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd73c7b1-90e7-41ca-9e6d-328aeb3d43b7 None admin] PATH_INFO: `/v3/roles` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:53.361163 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd73c7b1-90e7-41ca-9e6d-328aeb3d43b7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:26:53.361466 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd73c7b1-90e7-41ca-9e6d-328aeb3d43b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:53.362860 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd73c7b1-90e7-41ca-9e6d-328aeb3d43b7 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:53.379606 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 187/391] 10.222.0.104 () {56 vars in 1116 bytes} [Tue Aug 9 16:26:53 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:26:53.384741 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533e49fd-7de5-4100-bc4e-a03f74cee23c None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:53.530392 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533e49fd-7de5-4100-bc4e-a03f74cee23c None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:53.579183 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90db6d97-003e-432c-b1b0-2dc94f329533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:53.579766 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90db6d97-003e-432c-b1b0-2dc94f329533 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:53.580048 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90db6d97-003e-432c-b1b0-2dc94f329533 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:53.580326 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90db6d97-003e-432c-b1b0-2dc94f329533 None admin] PATH_INFO: `/v3/groups/3d825bb1f13649789718ba4a111c99b0` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:53.581610 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90db6d97-003e-432c-b1b0-2dc94f329533 None admin] RBAC: Authorizing `identity:get_group(group_id=3d825bb1f13649789718ba4a111c99b0)` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:53.583126 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90db6d97-003e-432c-b1b0-2dc94f329533 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:53.585149 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 205/392] 10.222.0.104 () {56 vars in 1185 bytes} [Tue Aug 9 16:26:53 2022] GET /identity/v3/groups/3d825bb1f13649789718ba4a111c99b0 => generated 227 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:26:53.590951 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd73c7b1-90e7-41ca-9e6d-328aeb3d43b7 None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:53.754877 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd73c7b1-90e7-41ca-9e6d-328aeb3d43b7 None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:53.784945 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a35637-2857-470a-b035-66555db37579 None None] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:53.785454 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a35637-2857-470a-b035-66555db37579 None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:53.785529 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a35637-2857-470a-b035-66555db37579 None None] PATH_INFO: `/` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:53.787116 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 206/393] 10.222.0.104 () {54 vars in 932 bytes} [Tue Aug 9 16:26:53 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:26:53.803433 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d94c9c-0e05-4866-b259-9a88a6798464 None None] REQUEST_METHOD: `POST` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:53.803713 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d94c9c-0e05-4866-b259-9a88a6798464 None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:53.803985 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d94c9c-0e05-4866-b259-9a88a6798464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:53.807525 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf1c5aa-785a-4903-84e6-50cf363bb79e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:53.808453 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf1c5aa-785a-4903-84e6-50cf363bb79e None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:53.808711 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf1c5aa-785a-4903-84e6-50cf363bb79e None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:53.808988 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf1c5aa-785a-4903-84e6-50cf363bb79e None admin] PATH_INFO: `/v3/projects/8e08184221014bc3bf771cdbe24c6720` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:53.811211 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf1c5aa-785a-4903-84e6-50cf363bb79e None admin] RBAC: Authorizing `identity:get_project(project_id=8e08184221014bc3bf771cdbe24c6720)` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:53.812653 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf1c5aa-785a-4903-84e6-50cf363bb79e None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:53.818928 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 188/394] 10.222.0.104 () {56 vars in 1191 bytes} [Tue Aug 9 16:26:53 2022] GET /identity/v3/projects/8e08184221014bc3bf771cdbe24c6720 => generated 299 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:26:53.824675 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:53.824806 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf1c5aa-785a-4903-84e6-50cf363bb79e None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:53.836136 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.auth.core [None req-53d94c9c-0e05-4866-b259-9a88a6798464 None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:26:53.837728 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.fernet_utils [None req-53d94c9c-0e05-4866-b259-9a88a6798464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:26:53.871073 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:53.918854 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 207/395] 10.222.0.104 () {58 vars in 1029 bytes} [Tue Aug 9 16:26:53 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 16:26:53.920460 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605fa3f7-5dfe-4a64-b5e9-43a485e7583c None None] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:53.920940 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605fa3f7-5dfe-4a64-b5e9-43a485e7583c None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:53.921402 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605fa3f7-5dfe-4a64-b5e9-43a485e7583c None None] PATH_INFO: `/` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:53.923299 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 208/396] 10.222.0.104 () {54 vars in 932 bytes} [Tue Aug 9 16:26:53 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:26:53.928587 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cd8ca9-5ac0-453d-a71f-dba2727fd350 None None] REQUEST_METHOD: `POST` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:53.929125 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cd8ca9-5ac0-453d-a71f-dba2727fd350 None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:53.929653 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cd8ca9-5ac0-453d-a71f-dba2727fd350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:53.958758 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.auth.core [None req-a3cd8ca9-5ac0-453d-a71f-dba2727fd350 None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:26:53.960524 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.fernet_utils [None req-a3cd8ca9-5ac0-453d-a71f-dba2727fd350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:26:53.961347 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf1c5aa-785a-4903-84e6-50cf363bb79e None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:54.005939 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbde3e0-4ff5-419e-a4ac-20c79f53047f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:54.006713 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbde3e0-4ff5-419e-a4ac-20c79f53047f None admin] REQUEST_METHOD: `PUT` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:54.007082 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbde3e0-4ff5-419e-a4ac-20c79f53047f None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:54.007427 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbde3e0-4ff5-419e-a4ac-20c79f53047f None admin] PATH_INFO: `/v3/projects/8e08184221014bc3bf771cdbe24c6720/groups/3d825bb1f13649789718ba4a111c99b0/roles/8a954d5b81f74df1985780d968ff3073` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:54.009845 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbde3e0-4ff5-419e-a4ac-20c79f53047f None admin] RBAC: Authorizing `identity:create_grant(project_id=8e08184221014bc3bf771cdbe24c6720, group_id=3d825bb1f13649789718ba4a111c99b0, role_id=8a954d5b81f74df1985780d968ff3073)` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:54.011905 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbde3e0-4ff5-419e-a4ac-20c79f53047f None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:54.030892 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 189/397] 10.222.0.104 () {58 vars in 1447 bytes} [Tue Aug 9 16:26:53 2022] PUT /identity/v3/projects/8e08184221014bc3bf771cdbe24c6720/groups/3d825bb1f13649789718ba4a111c99b0/roles/8a954d5b81f74df1985780d968ff3073 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 16:26:54.032432 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbde3e0-4ff5-419e-a4ac-20c79f53047f None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:54.051486 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 209/398] 10.222.0.104 () {58 vars in 1029 bytes} [Tue Aug 9 16:26:53 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 16:26:54.099565 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cd8ca9-5ac0-453d-a71f-dba2727fd350 None None] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:54.163400 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:54.168229 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbde3e0-4ff5-419e-a4ac-20c79f53047f None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:54.213104 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cce097-0238-4be6-b614-85a50726aade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:54.213763 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cce097-0238-4be6-b614-85a50726aade None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:54.214147 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cce097-0238-4be6-b614-85a50726aade None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:54.214425 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cce097-0238-4be6-b614-85a50726aade None admin] PATH_INFO: `/v3/roles/member` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:54.228160 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cce097-0238-4be6-b614-85a50726aade None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 16:26:54.236345 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application [None req-00cce097-0238-4be6-b614-85a50726aade None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 09 16:26:54.236345 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:26:54.236345 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:26:54.236345 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:26:54.236345 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:26:54.236345 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:26:54.236345 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:26:54.236345 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:26:54.236345 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:26:54.236345 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:26:54.236345 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:26:54.236345 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:26:54.236345 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 16:26:54.236345 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 16:26:54.236345 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 16:26:54.236345 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 16:26:54.237307 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 16:26:54.237307 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 16:26:54.237307 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 16:26:54.237307 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 16:26:54.237307 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:26:54.237307 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:26:54.237307 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:26:54.237307 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:26:54.237307 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:26:54.237307 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:26:54.237307 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:26:54.237307 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application with Lock( Aug 09 16:26:54.237307 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:26:54.237307 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:26:54.237307 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:26:54.237307 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:26:54.238141 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:26:54.238141 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:26:54.238141 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:26:54.238141 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:26:54.238141 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 16:26:54.238141 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 16:26:54.238141 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 16:26:54.238141 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 16:26:54.238141 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 16:26:54.238141 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 16:26:54.238141 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 09 16:26:54.238141 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Aug 09 16:26:54.238739 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 190/399] 10.222.0.104 () {56 vars in 1104 bytes} [Tue Aug 9 16:26:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 16:26:54.242531 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:54.246994 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cce097-0238-4be6-b614-85a50726aade None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:54.293508 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cd8ca9-5ac0-453d-a71f-dba2727fd350 None None] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:54.344942 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de43952-97b3-4101-a3e8-a5b69dc76351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:54.345657 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de43952-97b3-4101-a3e8-a5b69dc76351 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:54.345960 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de43952-97b3-4101-a3e8-a5b69dc76351 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:54.346236 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de43952-97b3-4101-a3e8-a5b69dc76351 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:54.360943 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de43952-97b3-4101-a3e8-a5b69dc76351 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 16:26:54.366678 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application [None req-9de43952-97b3-4101-a3e8-a5b69dc76351 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 16:26:54.366678 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:26:54.366678 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:26:54.366678 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:26:54.366678 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:26:54.366678 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:26:54.366678 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:26:54.366678 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:26:54.366678 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:26:54.366678 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:26:54.366678 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:26:54.366678 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:26:54.366678 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 16:26:54.366678 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 16:26:54.366678 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 16:26:54.366678 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 16:26:54.367789 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 16:26:54.367789 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 16:26:54.367789 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 16:26:54.367789 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 16:26:54.367789 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:26:54.367789 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:26:54.367789 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:26:54.367789 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:26:54.367789 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:26:54.367789 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:26:54.367789 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:26:54.367789 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application with Lock( Aug 09 16:26:54.367789 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:26:54.367789 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:26:54.367789 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:26:54.367789 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:26:54.368889 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:26:54.368889 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:26:54.368889 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:26:54.368889 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:26:54.368889 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 16:26:54.368889 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 16:26:54.368889 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 16:26:54.368889 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 16:26:54.368889 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 16:26:54.368889 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 16:26:54.368889 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 16:26:54.368889 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Aug 09 16:26:54.370294 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 210/400] 10.222.0.104 () {56 vars in 1119 bytes} [Tue Aug 9 16:26:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 16:26:54.381352 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de43952-97b3-4101-a3e8-a5b69dc76351 None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:54.392790 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cce097-0238-4be6-b614-85a50726aade None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:54.436864 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78492e09-a28b-4c52-b70c-bbec0777c085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:54.437719 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78492e09-a28b-4c52-b70c-bbec0777c085 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:54.438245 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78492e09-a28b-4c52-b70c-bbec0777c085 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:54.438658 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78492e09-a28b-4c52-b70c-bbec0777c085 None admin] PATH_INFO: `/v3/roles` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:54.439463 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78492e09-a28b-4c52-b70c-bbec0777c085 None admin] RBAC: Adding query filter params (name=member) {{(pid=87276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:26:54.439937 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78492e09-a28b-4c52-b70c-bbec0777c085 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:54.442040 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78492e09-a28b-4c52-b70c-bbec0777c085 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:54.453773 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 191/401] 10.222.0.104 () {56 vars in 1106 bytes} [Tue Aug 9 16:26:54 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:26:54.459675 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78492e09-a28b-4c52-b70c-bbec0777c085 None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:54.492192 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:54.527587 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de43952-97b3-4101-a3e8-a5b69dc76351 None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:54.564763 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:54.576733 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7ef553-8fa9-4a73-8b70-1781fa1ed930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:54.577496 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7ef553-8fa9-4a73-8b70-1781fa1ed930 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:54.577885 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7ef553-8fa9-4a73-8b70-1781fa1ed930 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:54.578267 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7ef553-8fa9-4a73-8b70-1781fa1ed930 None admin] PATH_INFO: `/v3/roles` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:54.579176 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7ef553-8fa9-4a73-8b70-1781fa1ed930 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:26:54.579587 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7ef553-8fa9-4a73-8b70-1781fa1ed930 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:54.581138 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7ef553-8fa9-4a73-8b70-1781fa1ed930 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:54.594147 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 211/402] 10.222.0.104 () {56 vars in 1116 bytes} [Tue Aug 9 16:26:54 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:26:54.595638 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d413d512-eed0-4101-9f77-550bd7131b60 None None] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:54.596011 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d413d512-eed0-4101-9f77-550bd7131b60 None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:54.596376 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d413d512-eed0-4101-9f77-550bd7131b60 None None] PATH_INFO: `/` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:54.597880 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 212/403] 10.222.0.104 () {54 vars in 932 bytes} [Tue Aug 9 16:26:54 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:26:54.599367 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d413d512-eed0-4101-9f77-550bd7131b60 None None] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:54.601555 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78492e09-a28b-4c52-b70c-bbec0777c085 None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:54.639978 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa298bd5-daee-49b2-8910-2b6dcacad54e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:54.640990 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa298bd5-daee-49b2-8910-2b6dcacad54e None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:54.641403 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa298bd5-daee-49b2-8910-2b6dcacad54e None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:54.641813 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa298bd5-daee-49b2-8910-2b6dcacad54e None admin] PATH_INFO: `/v3/groups/3d825bb1f13649789718ba4a111c99b0` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:54.643137 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa298bd5-daee-49b2-8910-2b6dcacad54e None admin] RBAC: Authorizing `identity:get_group(group_id=3d825bb1f13649789718ba4a111c99b0)` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:54.645050 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa298bd5-daee-49b2-8910-2b6dcacad54e None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:54.646850 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 192/404] 10.222.0.104 () {56 vars in 1185 bytes} [Tue Aug 9 16:26:54 2022] GET /identity/v3/groups/3d825bb1f13649789718ba4a111c99b0 => generated 227 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 16:26:54.648137 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4594fabe-8186-4963-afb9-791b7d5ab4c5 None None] REQUEST_METHOD: `POST` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:54.653044 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4594fabe-8186-4963-afb9-791b7d5ab4c5 None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:54.653507 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4594fabe-8186-4963-afb9-791b7d5ab4c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:54.673122 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.auth.core [None req-4594fabe-8186-4963-afb9-791b7d5ab4c5 None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:26:54.674650 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.fernet_utils [None req-4594fabe-8186-4963-afb9-791b7d5ab4c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:26:54.734779 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d413d512-eed0-4101-9f77-550bd7131b60 None None] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:54.758541 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 193/405] 10.222.0.104 () {58 vars in 1029 bytes} [Tue Aug 9 16:26:54 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 16:26:54.759756 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4594fabe-8186-4963-afb9-791b7d5ab4c5 None None] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:54.789633 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa701a04-3896-4bbb-9e53-4be0659f651e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:54.790359 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa701a04-3896-4bbb-9e53-4be0659f651e None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:54.790639 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa701a04-3896-4bbb-9e53-4be0659f651e None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:54.790913 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa701a04-3896-4bbb-9e53-4be0659f651e None admin] PATH_INFO: `/v3/groups/3d825bb1f13649789718ba4a111c99b0` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:54.792549 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:54.793512 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa701a04-3896-4bbb-9e53-4be0659f651e None admin] RBAC: Authorizing `identity:get_group(group_id=3d825bb1f13649789718ba4a111c99b0)` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:54.795848 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa701a04-3896-4bbb-9e53-4be0659f651e None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:54.797646 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 213/406] 10.222.0.104 () {56 vars in 1185 bytes} [Tue Aug 9 16:26:54 2022] GET /identity/v3/groups/3d825bb1f13649789718ba4a111c99b0 => generated 227 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:26:54.802252 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa701a04-3896-4bbb-9e53-4be0659f651e None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:54.880410 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:54.907609 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4594fabe-8186-4963-afb9-791b7d5ab4c5 None None] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:54.942429 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa701a04-3896-4bbb-9e53-4be0659f651e None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:54.959932 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50614509-8cb5-40b3-a84d-659469422858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:54.960605 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50614509-8cb5-40b3-a84d-659469422858 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:54.960888 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50614509-8cb5-40b3-a84d-659469422858 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:54.961161 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50614509-8cb5-40b3-a84d-659469422858 None admin] PATH_INFO: `/v3/projects/01f42016635a4e7ab655700eadbb1d93` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:54.963281 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50614509-8cb5-40b3-a84d-659469422858 None admin] RBAC: Authorizing `identity:get_project(project_id=01f42016635a4e7ab655700eadbb1d93)` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:54.964848 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50614509-8cb5-40b3-a84d-659469422858 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:54.972134 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 194/407] 10.222.0.104 () {56 vars in 1191 bytes} [Tue Aug 9 16:26:54 2022] GET /identity/v3/projects/01f42016635a4e7ab655700eadbb1d93 => generated 303 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:26:54.972134 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50614509-8cb5-40b3-a84d-659469422858 None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:54.988318 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47658ed-7684-4940-938c-640dc1915929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:54.989314 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47658ed-7684-4940-938c-640dc1915929 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:54.989813 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47658ed-7684-4940-938c-640dc1915929 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:54.990328 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47658ed-7684-4940-938c-640dc1915929 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:55.003793 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47658ed-7684-4940-938c-640dc1915929 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 16:26:55.010648 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application [None req-c47658ed-7684-4940-938c-640dc1915929 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 16:26:55.010648 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:26:55.010648 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:26:55.010648 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:26:55.010648 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:26:55.010648 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:26:55.010648 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:26:55.010648 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:26:55.010648 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:26:55.010648 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:26:55.010648 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:26:55.010648 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:26:55.010648 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 16:26:55.010648 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 16:26:55.010648 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 16:26:55.010648 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 16:26:55.011578 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 16:26:55.011578 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 16:26:55.011578 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 16:26:55.011578 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 16:26:55.011578 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:26:55.011578 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:26:55.011578 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:26:55.011578 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:26:55.011578 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:26:55.011578 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:26:55.011578 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:26:55.011578 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application with Lock( Aug 09 16:26:55.011578 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:26:55.011578 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:26:55.011578 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:26:55.011578 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:26:55.012394 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:26:55.012394 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:26:55.012394 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:26:55.012394 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:26:55.012394 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 16:26:55.012394 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 16:26:55.012394 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 16:26:55.012394 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 16:26:55.012394 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 16:26:55.012394 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 16:26:55.012394 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 16:26:55.012394 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Aug 09 16:26:55.016298 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 214/408] 10.222.0.104 () {56 vars in 1101 bytes} [Tue Aug 9 16:26:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 16:26:55.017398 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47658ed-7684-4940-938c-640dc1915929 None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:55.078861 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:55.098469 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50614509-8cb5-40b3-a84d-659469422858 None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:55.137237 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130a738d-0ea4-49d0-b5f8-1b3640e72775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:55.138286 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130a738d-0ea4-49d0-b5f8-1b3640e72775 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:55.139306 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130a738d-0ea4-49d0-b5f8-1b3640e72775 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:55.139784 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130a738d-0ea4-49d0-b5f8-1b3640e72775 None admin] PATH_INFO: `/v3/projects/01f42016635a4e7ab655700eadbb1d93` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:55.141157 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130a738d-0ea4-49d0-b5f8-1b3640e72775 None admin] RBAC: Authorizing `identity:get_project(project_id=01f42016635a4e7ab655700eadbb1d93)` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:55.142914 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130a738d-0ea4-49d0-b5f8-1b3640e72775 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:55.144804 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 195/409] 10.222.0.104 () {56 vars in 1191 bytes} [Tue Aug 9 16:26:54 2022] GET /identity/v3/projects/01f42016635a4e7ab655700eadbb1d93 => generated 303 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:26:55.145814 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130a738d-0ea4-49d0-b5f8-1b3640e72775 None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:55.148821 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47658ed-7684-4940-938c-640dc1915929 None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:55.167630 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:55.190090 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3c6671-ba5a-4ce2-abfc-7cb26e75263b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:55.190989 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3c6671-ba5a-4ce2-abfc-7cb26e75263b None admin] REQUEST_METHOD: `PUT` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:55.191185 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3c6671-ba5a-4ce2-abfc-7cb26e75263b None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:55.191401 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3c6671-ba5a-4ce2-abfc-7cb26e75263b None admin] PATH_INFO: `/v3/projects/01f42016635a4e7ab655700eadbb1d93/groups/3d825bb1f13649789718ba4a111c99b0/roles/044ca4f80141492b9c128ada543865e8` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:55.193612 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3c6671-ba5a-4ce2-abfc-7cb26e75263b None admin] RBAC: Authorizing `identity:create_grant(project_id=01f42016635a4e7ab655700eadbb1d93, group_id=3d825bb1f13649789718ba4a111c99b0, role_id=044ca4f80141492b9c128ada543865e8)` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:55.195326 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3c6671-ba5a-4ce2-abfc-7cb26e75263b None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:55.216838 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 215/410] 10.222.0.104 () {58 vars in 1447 bytes} [Tue Aug 9 16:26:55 2022] PUT /identity/v3/projects/01f42016635a4e7ab655700eadbb1d93/groups/3d825bb1f13649789718ba4a111c99b0/roles/044ca4f80141492b9c128ada543865e8 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 16:26:55.216838 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3c6671-ba5a-4ce2-abfc-7cb26e75263b None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:55.290977 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130a738d-0ea4-49d0-b5f8-1b3640e72775 None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:55.333280 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3c6671-ba5a-4ce2-abfc-7cb26e75263b None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:55.345730 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabf2238-064c-47f7-b93d-acce74c39e01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:55.346406 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabf2238-064c-47f7-b93d-acce74c39e01 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:55.346686 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabf2238-064c-47f7-b93d-acce74c39e01 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:55.347419 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabf2238-064c-47f7-b93d-acce74c39e01 None admin] PATH_INFO: `/v3/roles` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:55.348431 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabf2238-064c-47f7-b93d-acce74c39e01 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:26:55.348743 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabf2238-064c-47f7-b93d-acce74c39e01 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:55.350568 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabf2238-064c-47f7-b93d-acce74c39e01 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:55.366101 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 196/411] 10.222.0.104 () {56 vars in 1104 bytes} [Tue Aug 9 16:26:55 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:26:55.367900 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a33769-20e5-41ae-ace9-02a41a7dc0cd None None] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:55.368195 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a33769-20e5-41ae-ace9-02a41a7dc0cd None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:55.368469 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a33769-20e5-41ae-ace9-02a41a7dc0cd None None] PATH_INFO: `/` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:55.369941 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 197/412] 10.222.0.104 () {54 vars in 932 bytes} [Tue Aug 9 16:26:55 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:26:55.371861 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a33769-20e5-41ae-ace9-02a41a7dc0cd None None] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:55.391765 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bbd64a-ac6e-4eb5-9d5e-abc25815928f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:55.392932 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bbd64a-ac6e-4eb5-9d5e-abc25815928f None admin] REQUEST_METHOD: `PUT` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:55.393242 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bbd64a-ac6e-4eb5-9d5e-abc25815928f None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:55.393804 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bbd64a-ac6e-4eb5-9d5e-abc25815928f None admin] PATH_INFO: `/v3/projects/01f42016635a4e7ab655700eadbb1d93/groups/3d825bb1f13649789718ba4a111c99b0/roles/8a954d5b81f74df1985780d968ff3073` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:55.396522 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bbd64a-ac6e-4eb5-9d5e-abc25815928f None admin] RBAC: Authorizing `identity:create_grant(project_id=01f42016635a4e7ab655700eadbb1d93, group_id=3d825bb1f13649789718ba4a111c99b0, role_id=8a954d5b81f74df1985780d968ff3073)` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:55.398909 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bbd64a-ac6e-4eb5-9d5e-abc25815928f None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:55.401470 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:55.419325 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 216/413] 10.222.0.104 () {58 vars in 1447 bytes} [Tue Aug 9 16:26:55 2022] PUT /identity/v3/projects/01f42016635a4e7ab655700eadbb1d93/groups/3d825bb1f13649789718ba4a111c99b0/roles/8a954d5b81f74df1985780d968ff3073 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 16:26:55.421939 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63fc9db-a769-4ccd-9d40-d50c9dfd87e8 None None] REQUEST_METHOD: `POST` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:55.422518 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63fc9db-a769-4ccd-9d40-d50c9dfd87e8 None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:55.423075 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63fc9db-a769-4ccd-9d40-d50c9dfd87e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:55.449566 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.auth.core [None req-d63fc9db-a769-4ccd-9d40-d50c9dfd87e8 None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:26:55.451589 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.fernet_utils [None req-d63fc9db-a769-4ccd-9d40-d50c9dfd87e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:26:55.497889 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:55.519762 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a33769-20e5-41ae-ace9-02a41a7dc0cd None None] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:55.553534 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 217/414] 10.222.0.104 () {58 vars in 1029 bytes} [Tue Aug 9 16:26:55 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 16:26:55.584996 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d73656-562c-4024-a9ad-7940134c0960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:55.586013 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d73656-562c-4024-a9ad-7940134c0960 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:55.586432 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d73656-562c-4024-a9ad-7940134c0960 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:55.586842 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d73656-562c-4024-a9ad-7940134c0960 None admin] PATH_INFO: `/v3/groups/00196bcbfe984dcdaf75768d99d04259` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:55.590792 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d73656-562c-4024-a9ad-7940134c0960 None admin] RBAC: Authorizing `identity:get_group(group_id=00196bcbfe984dcdaf75768d99d04259)` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:55.593037 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d73656-562c-4024-a9ad-7940134c0960 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:55.595249 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 198/415] 10.222.0.104 () {56 vars in 1185 bytes} [Tue Aug 9 16:26:55 2022] GET /identity/v3/groups/00196bcbfe984dcdaf75768d99d04259 => generated 230 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:26:55.601643 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63fc9db-a769-4ccd-9d40-d50c9dfd87e8 None None] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:55.607755 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d73656-562c-4024-a9ad-7940134c0960 None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:55.726260 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:55.741420 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63fc9db-a769-4ccd-9d40-d50c9dfd87e8 None None] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:55.744525 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d73656-562c-4024-a9ad-7940134c0960 None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:55.796492 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dede417a-8bdd-4039-a306-eae7949a6693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:55.797135 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dede417a-8bdd-4039-a306-eae7949a6693 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:55.797413 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dede417a-8bdd-4039-a306-eae7949a6693 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:55.797685 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dede417a-8bdd-4039-a306-eae7949a6693 None admin] PATH_INFO: `/v3/projects/7ce95c8faa1d4165b111ca9c55852804` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:55.798867 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dede417a-8bdd-4039-a306-eae7949a6693 None admin] RBAC: Authorizing `identity:get_project(project_id=7ce95c8faa1d4165b111ca9c55852804)` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:55.800317 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dede417a-8bdd-4039-a306-eae7949a6693 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:55.802129 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 218/416] 10.222.0.104 () {56 vars in 1191 bytes} [Tue Aug 9 16:26:55 2022] GET /identity/v3/projects/7ce95c8faa1d4165b111ca9c55852804 => generated 345 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:26:55.808489 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dede417a-8bdd-4039-a306-eae7949a6693 None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:55.810051 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0059a3f2-725a-4c1e-9146-7a4d48938452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:55.811296 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0059a3f2-725a-4c1e-9146-7a4d48938452 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:55.811768 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0059a3f2-725a-4c1e-9146-7a4d48938452 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:55.813223 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0059a3f2-725a-4c1e-9146-7a4d48938452 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:55.840802 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0059a3f2-725a-4c1e-9146-7a4d48938452 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 16:26:55.846707 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application [None req-0059a3f2-725a-4c1e-9146-7a4d48938452 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 09 16:26:55.846707 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:26:55.846707 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:26:55.846707 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:26:55.846707 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:26:55.846707 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:26:55.846707 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:26:55.846707 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:26:55.846707 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:26:55.846707 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:26:55.846707 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:26:55.846707 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:26:55.846707 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 16:26:55.846707 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 16:26:55.846707 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 16:26:55.846707 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 16:26:55.847550 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 16:26:55.847550 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 16:26:55.847550 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 16:26:55.847550 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 16:26:55.847550 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:26:55.847550 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:26:55.847550 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:26:55.847550 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:26:55.847550 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:26:55.847550 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:26:55.847550 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:26:55.847550 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application with Lock( Aug 09 16:26:55.847550 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:26:55.847550 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:26:55.847550 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:26:55.847550 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:26:55.848353 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:26:55.848353 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:26:55.848353 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:26:55.848353 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:26:55.848353 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 16:26:55.848353 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 16:26:55.848353 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 16:26:55.848353 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 16:26:55.848353 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 16:26:55.848353 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 16:26:55.848353 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 09 16:26:55.848353 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Aug 09 16:26:55.849563 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 199/417] 10.222.0.104 () {56 vars in 1104 bytes} [Tue Aug 9 16:26:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 16:26:55.861724 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0059a3f2-725a-4c1e-9146-7a4d48938452 None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:55.863228 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:55.957099 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dede417a-8bdd-4039-a306-eae7949a6693 None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:55.995352 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d22070d-4206-4e9b-8b57-9c552d785a37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:55.996403 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d22070d-4206-4e9b-8b57-9c552d785a37 None admin] REQUEST_METHOD: `PUT` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:55.996893 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d22070d-4206-4e9b-8b57-9c552d785a37 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:55.997359 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d22070d-4206-4e9b-8b57-9c552d785a37 None admin] PATH_INFO: `/v3/projects/7ce95c8faa1d4165b111ca9c55852804/groups/00196bcbfe984dcdaf75768d99d04259/roles/c0143e35c1344a39a931bbb6bcd5acdc` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:55.999563 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d22070d-4206-4e9b-8b57-9c552d785a37 None admin] RBAC: Authorizing `identity:create_grant(project_id=7ce95c8faa1d4165b111ca9c55852804, group_id=00196bcbfe984dcdaf75768d99d04259, role_id=c0143e35c1344a39a931bbb6bcd5acdc)` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:56.001195 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d22070d-4206-4e9b-8b57-9c552d785a37 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:56.015881 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 219/418] 10.222.0.104 () {58 vars in 1447 bytes} [Tue Aug 9 16:26:55 2022] PUT /identity/v3/projects/7ce95c8faa1d4165b111ca9c55852804/groups/00196bcbfe984dcdaf75768d99d04259/roles/c0143e35c1344a39a931bbb6bcd5acdc => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 16:26:56.077787 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0059a3f2-725a-4c1e-9146-7a4d48938452 None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:56.133544 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d69153d-0354-4206-af08-f122ac7aeb50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:56.134207 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d69153d-0354-4206-af08-f122ac7aeb50 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:56.134489 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d69153d-0354-4206-af08-f122ac7aeb50 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:56.134762 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d69153d-0354-4206-af08-f122ac7aeb50 None admin] PATH_INFO: `/v3/roles` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:56.135441 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d69153d-0354-4206-af08-f122ac7aeb50 None admin] RBAC: Adding query filter params (name=member) {{(pid=87276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:26:56.135745 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d69153d-0354-4206-af08-f122ac7aeb50 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:56.137191 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d69153d-0354-4206-af08-f122ac7aeb50 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:56.147509 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 200/419] 10.222.0.104 () {56 vars in 1106 bytes} [Tue Aug 9 16:26:55 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:26:56.153046 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d22070d-4206-4e9b-8b57-9c552d785a37 None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:56.284890 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:56.294423 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d22070d-4206-4e9b-8b57-9c552d785a37 None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:56.337992 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cf2be2-432b-4f93-9ad9-f7326384fab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:56.338659 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cf2be2-432b-4f93-9ad9-f7326384fab3 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:56.338939 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cf2be2-432b-4f93-9ad9-f7326384fab3 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:56.339310 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cf2be2-432b-4f93-9ad9-f7326384fab3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:56.425225 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cf2be2-432b-4f93-9ad9-f7326384fab3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:56.426716 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cf2be2-432b-4f93-9ad9-f7326384fab3 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:56.533052 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:56.541192 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 220/420] 10.222.0.104 () {58 vars in 1287 bytes} [Tue Aug 9 16:26:56 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 16:26:56.547599 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d69153d-0354-4206-af08-f122ac7aeb50 None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:56.566247 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:56.675936 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d69153d-0354-4206-af08-f122ac7aeb50 None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:56.718200 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9e8007-06ca-4a81-885d-967821f45ea4 None None] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:56.718491 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9e8007-06ca-4a81-885d-967821f45ea4 None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:56.718742 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9e8007-06ca-4a81-885d-967821f45ea4 None None] PATH_INFO: `/` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:56.720132 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746abe8a-ebe0-4f0e-a88f-7cb7c599cd3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:56.720777 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746abe8a-ebe0-4f0e-a88f-7cb7c599cd3b None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:56.721058 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746abe8a-ebe0-4f0e-a88f-7cb7c599cd3b None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:56.721331 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746abe8a-ebe0-4f0e-a88f-7cb7c599cd3b None admin] PATH_INFO: `/v3/projects/8e08184221014bc3bf771cdbe24c6720` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:56.722508 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746abe8a-ebe0-4f0e-a88f-7cb7c599cd3b None admin] RBAC: Authorizing `identity:get_project(project_id=8e08184221014bc3bf771cdbe24c6720)` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:56.723942 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746abe8a-ebe0-4f0e-a88f-7cb7c599cd3b None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:56.724915 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 221/421] 10.222.0.104 () {54 vars in 932 bytes} [Tue Aug 9 16:26:56 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 09 16:26:56.725816 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 201/422] 10.222.0.104 () {56 vars in 1191 bytes} [Tue Aug 9 16:26:56 2022] GET /identity/v3/projects/8e08184221014bc3bf771cdbe24c6720 => generated 299 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:26:56.731207 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1ca262-e4e9-42b7-a9d7-f9274fdab5f2 None None] REQUEST_METHOD: `POST` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:56.731767 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1ca262-e4e9-42b7-a9d7-f9274fdab5f2 None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:56.732760 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1ca262-e4e9-42b7-a9d7-f9274fdab5f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:56.735693 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746abe8a-ebe0-4f0e-a88f-7cb7c599cd3b None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:56.764235 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.auth.core [None req-bf1ca262-e4e9-42b7-a9d7-f9274fdab5f2 None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:26:56.765886 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.fernet_utils [None req-bf1ca262-e4e9-42b7-a9d7-f9274fdab5f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:26:56.849303 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 222/423] 10.222.0.104 () {58 vars in 1029 bytes} [Tue Aug 9 16:26:56 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 16:26:56.875163 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1ca262-e4e9-42b7-a9d7-f9274fdab5f2 None None] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:56.908076 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:56.957650 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746abe8a-ebe0-4f0e-a88f-7cb7c599cd3b None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:57.032846 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0215a2af-d91e-4e0a-9825-ba6501cac434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:57.033489 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0215a2af-d91e-4e0a-9825-ba6501cac434 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:57.033817 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0215a2af-d91e-4e0a-9825-ba6501cac434 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:57.034095 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0215a2af-d91e-4e0a-9825-ba6501cac434 None admin] PATH_INFO: `/v3/groups/3d825bb1f13649789718ba4a111c99b0` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:57.039777 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0215a2af-d91e-4e0a-9825-ba6501cac434 None admin] RBAC: Authorizing `identity:get_group(group_id=3d825bb1f13649789718ba4a111c99b0)` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:57.041257 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0215a2af-d91e-4e0a-9825-ba6501cac434 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:57.047678 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 202/424] 10.222.0.104 () {56 vars in 1185 bytes} [Tue Aug 9 16:26:56 2022] GET /identity/v3/groups/3d825bb1f13649789718ba4a111c99b0 => generated 227 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 16:26:57.051414 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0215a2af-d91e-4e0a-9825-ba6501cac434 None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:57.101257 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1ca262-e4e9-42b7-a9d7-f9274fdab5f2 None None] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:57.163308 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:57.202834 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0215a2af-d91e-4e0a-9825-ba6501cac434 None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:57.210847 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed9cf20-0eab-4648-b2a4-b6e3f60cd6a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:57.211603 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed9cf20-0eab-4648-b2a4-b6e3f60cd6a1 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:57.212007 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed9cf20-0eab-4648-b2a4-b6e3f60cd6a1 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:57.212376 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed9cf20-0eab-4648-b2a4-b6e3f60cd6a1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:57.239926 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62817ec-874a-4049-b25d-b5cdaad22829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:57.240788 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62817ec-874a-4049-b25d-b5cdaad22829 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:57.241208 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62817ec-874a-4049-b25d-b5cdaad22829 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:57.241742 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62817ec-874a-4049-b25d-b5cdaad22829 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:57.242656 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62817ec-874a-4049-b25d-b5cdaad22829 None admin] RBAC: Adding query filter params (group.id=3d825bb1f13649789718ba4a111c99b0, role.id=044ca4f80141492b9c128ada543865e8, scope.project.id=8e08184221014bc3bf771cdbe24c6720) {{(pid=87276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:26:57.243094 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62817ec-874a-4049-b25d-b5cdaad22829 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:57.244646 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62817ec-874a-4049-b25d-b5cdaad22829 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:57.246877 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed9cf20-0eab-4648-b2a4-b6e3f60cd6a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 16:26:57.252191 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 203/425] 10.222.0.104 () {56 vars in 1381 bytes} [Tue Aug 9 16:26:57 2022] GET /identity/v3/role_assignments?group.id=3d825bb1f13649789718ba4a111c99b0&scope.project.id=8e08184221014bc3bf771cdbe24c6720&role.id=044ca4f80141492b9c128ada543865e8 => generated 613 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:26:57.254231 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application [None req-bed9cf20-0eab-4648-b2a4-b6e3f60cd6a1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 16:26:57.254231 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:26:57.254231 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:26:57.254231 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:26:57.254231 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:26:57.254231 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:26:57.254231 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:26:57.254231 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:26:57.254231 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:26:57.254231 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:26:57.254231 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:26:57.254231 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:26:57.254231 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 16:26:57.254231 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 16:26:57.254231 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 16:26:57.254231 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 16:26:57.255168 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 16:26:57.255168 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 16:26:57.255168 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 16:26:57.255168 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 16:26:57.255168 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:26:57.255168 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:26:57.255168 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:26:57.255168 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:26:57.255168 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:26:57.255168 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:26:57.255168 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:26:57.255168 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application with Lock( Aug 09 16:26:57.255168 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:26:57.255168 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:26:57.255168 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:26:57.255168 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:26:57.255976 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:26:57.255976 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:26:57.255976 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:26:57.255976 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:26:57.255976 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 16:26:57.255976 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 16:26:57.255976 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 16:26:57.255976 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 16:26:57.255976 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 16:26:57.255976 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 16:26:57.255976 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 16:26:57.255976 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Aug 09 16:26:57.258518 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 223/426] 10.222.0.104 () {56 vars in 1119 bytes} [Tue Aug 9 16:26:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 385 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 16:26:57.271208 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62817ec-874a-4049-b25d-b5cdaad22829 None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:57.286579 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:57.388159 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62817ec-874a-4049-b25d-b5cdaad22829 None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:57.425986 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cc7dcd-342c-4457-ad19-1ca457bcf859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:57.426875 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cc7dcd-342c-4457-ad19-1ca457bcf859 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:57.427304 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cc7dcd-342c-4457-ad19-1ca457bcf859 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:57.427718 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cc7dcd-342c-4457-ad19-1ca457bcf859 None admin] PATH_INFO: `/v3/roles` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:57.428553 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cc7dcd-342c-4457-ad19-1ca457bcf859 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:26:57.429002 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cc7dcd-342c-4457-ad19-1ca457bcf859 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:57.430565 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cc7dcd-342c-4457-ad19-1ca457bcf859 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:57.441789 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 204/427] 10.222.0.104 () {56 vars in 1116 bytes} [Tue Aug 9 16:26:57 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:26:57.447306 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed9cf20-0eab-4648-b2a4-b6e3f60cd6a1 None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:57.568214 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed9cf20-0eab-4648-b2a4-b6e3f60cd6a1 None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:57.605652 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ae4c41-7dc0-4467-99b6-2bddfaf53602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:57.606645 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ae4c41-7dc0-4467-99b6-2bddfaf53602 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:57.607093 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ae4c41-7dc0-4467-99b6-2bddfaf53602 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:57.607510 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ae4c41-7dc0-4467-99b6-2bddfaf53602 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:57.665333 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:57.682906 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ae4c41-7dc0-4467-99b6-2bddfaf53602 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:57.684758 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ae4c41-7dc0-4467-99b6-2bddfaf53602 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:57.801116 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 224/428] 10.222.0.104 () {58 vars in 1287 bytes} [Tue Aug 9 16:26:57 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 09 16:26:57.806694 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cc7dcd-342c-4457-ad19-1ca457bcf859 None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:57.898112 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:57.942725 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cc7dcd-342c-4457-ad19-1ca457bcf859 None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:57.982235 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81429547-064a-45da-b8e0-5498b3c23d30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:57.982888 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81429547-064a-45da-b8e0-5498b3c23d30 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:57.983221 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81429547-064a-45da-b8e0-5498b3c23d30 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:57.983506 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81429547-064a-45da-b8e0-5498b3c23d30 None admin] PATH_INFO: `/v3/projects/8e08184221014bc3bf771cdbe24c6720` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:57.984657 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81429547-064a-45da-b8e0-5498b3c23d30 None admin] RBAC: Authorizing `identity:get_project(project_id=8e08184221014bc3bf771cdbe24c6720)` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:57.986123 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81429547-064a-45da-b8e0-5498b3c23d30 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:57.988061 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 205/429] 10.222.0.104 () {56 vars in 1191 bytes} [Tue Aug 9 16:26:57 2022] GET /identity/v3/projects/8e08184221014bc3bf771cdbe24c6720 => generated 299 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:26:57.993881 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ae4c41-7dc0-4467-99b6-2bddfaf53602 None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:58.100176 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:58.120596 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ae4c41-7dc0-4467-99b6-2bddfaf53602 None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:58.151684 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f191db-ebb7-46d8-873c-07d8934481b0 None None] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:58.151994 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f191db-ebb7-46d8-873c-07d8934481b0 None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:58.152240 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f191db-ebb7-46d8-873c-07d8934481b0 None None] PATH_INFO: `/` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:58.153976 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 206/430] 10.222.0.104 () {54 vars in 932 bytes} [Tue Aug 9 16:26:58 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 09 16:26:58.161124 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40566d96-dd24-459c-afce-158d9508ac8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:58.161778 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40566d96-dd24-459c-afce-158d9508ac8f None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:58.162102 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40566d96-dd24-459c-afce-158d9508ac8f None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:58.162380 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40566d96-dd24-459c-afce-158d9508ac8f None admin] PATH_INFO: `/v3/groups/3d825bb1f13649789718ba4a111c99b0` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:58.163641 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40566d96-dd24-459c-afce-158d9508ac8f None admin] RBAC: Authorizing `identity:get_group(group_id=3d825bb1f13649789718ba4a111c99b0)` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:58.164549 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152c5189-cd2d-4bd7-857e-3f7b4ddd016b None None] REQUEST_METHOD: `POST` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:58.164836 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152c5189-cd2d-4bd7-857e-3f7b4ddd016b None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:58.165095 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40566d96-dd24-459c-afce-158d9508ac8f None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:58.165197 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152c5189-cd2d-4bd7-857e-3f7b4ddd016b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:58.166981 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 225/431] 10.222.0.104 () {56 vars in 1185 bytes} [Tue Aug 9 16:26:57 2022] GET /identity/v3/groups/3d825bb1f13649789718ba4a111c99b0 => generated 227 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:26:58.175163 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40566d96-dd24-459c-afce-158d9508ac8f None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:58.194818 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.auth.core [None req-152c5189-cd2d-4bd7-857e-3f7b4ddd016b None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:26:58.195944 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.fernet_utils [None req-152c5189-cd2d-4bd7-857e-3f7b4ddd016b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:26:58.298988 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 207/432] 10.222.0.104 () {58 vars in 1029 bytes} [Tue Aug 9 16:26:58 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 16:26:58.301057 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a336addb-5856-481b-b931-ef5cca27b98b None None] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:58.301401 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a336addb-5856-481b-b931-ef5cca27b98b None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:58.301682 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a336addb-5856-481b-b931-ef5cca27b98b None None] PATH_INFO: `/` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:58.303955 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 208/433] 10.222.0.104 () {54 vars in 932 bytes} [Tue Aug 9 16:26:58 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:26:58.305785 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40566d96-dd24-459c-afce-158d9508ac8f None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:58.310923 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12c6120-c122-436c-a99d-912aa2f7eac9 None None] REQUEST_METHOD: `POST` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:58.311432 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12c6120-c122-436c-a99d-912aa2f7eac9 None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:58.311930 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12c6120-c122-436c-a99d-912aa2f7eac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:58.335851 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.auth.core [None req-e12c6120-c122-436c-a99d-912aa2f7eac9 None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:26:58.337681 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.fernet_utils [None req-e12c6120-c122-436c-a99d-912aa2f7eac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:26:58.350351 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a42dd4-2136-4cc0-a8e7-1f603e9688df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:58.351104 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a42dd4-2136-4cc0-a8e7-1f603e9688df None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:58.351482 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a42dd4-2136-4cc0-a8e7-1f603e9688df None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:58.351759 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a42dd4-2136-4cc0-a8e7-1f603e9688df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:58.354901 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a42dd4-2136-4cc0-a8e7-1f603e9688df None admin] RBAC: Adding query filter params (group.id=3d825bb1f13649789718ba4a111c99b0, role.id=8a954d5b81f74df1985780d968ff3073, scope.project.id=8e08184221014bc3bf771cdbe24c6720) {{(pid=87275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:26:58.354901 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a42dd4-2136-4cc0-a8e7-1f603e9688df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:58.355477 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a42dd4-2136-4cc0-a8e7-1f603e9688df None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:58.362416 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 226/434] 10.222.0.104 () {56 vars in 1381 bytes} [Tue Aug 9 16:26:58 2022] GET /identity/v3/role_assignments?group.id=3d825bb1f13649789718ba4a111c99b0&scope.project.id=8e08184221014bc3bf771cdbe24c6720&role.id=8a954d5b81f74df1985780d968ff3073 => generated 613 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:26:58.363589 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a42dd4-2136-4cc0-a8e7-1f603e9688df None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:58.393418 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:58.442367 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:58.449494 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 209/435] 10.222.0.104 () {58 vars in 1029 bytes} [Tue Aug 9 16:26:58 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 16:26:58.476104 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12c6120-c122-436c-a99d-912aa2f7eac9 None None] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:58.507380 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a42dd4-2136-4cc0-a8e7-1f603e9688df None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:58.548696 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4c2509-09ac-47c3-be06-740ed24fd1d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:58.549492 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4c2509-09ac-47c3-be06-740ed24fd1d3 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:58.550198 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4c2509-09ac-47c3-be06-740ed24fd1d3 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:58.550444 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4c2509-09ac-47c3-be06-740ed24fd1d3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:58.563787 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4c2509-09ac-47c3-be06-740ed24fd1d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 16:26:58.568884 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application [None req-5f4c2509-09ac-47c3-be06-740ed24fd1d3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 09 16:26:58.568884 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:26:58.568884 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:26:58.568884 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:26:58.568884 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:26:58.568884 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:26:58.568884 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:26:58.568884 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:26:58.568884 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:26:58.568884 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:26:58.568884 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:26:58.568884 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:26:58.568884 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 16:26:58.568884 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 16:26:58.568884 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 16:26:58.568884 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 16:26:58.570011 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 16:26:58.570011 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 16:26:58.570011 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 16:26:58.570011 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 16:26:58.570011 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:26:58.570011 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:26:58.570011 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:26:58.570011 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:26:58.570011 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:26:58.570011 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:26:58.570011 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:26:58.570011 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application with Lock( Aug 09 16:26:58.570011 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:26:58.570011 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:26:58.570011 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:26:58.570011 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:26:58.571176 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:26:58.571176 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:26:58.571176 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:26:58.571176 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:26:58.571176 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 16:26:58.571176 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 16:26:58.571176 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 16:26:58.571176 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 16:26:58.571176 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 16:26:58.571176 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 16:26:58.571176 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 09 16:26:58.571176 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Aug 09 16:26:58.571176 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 227/436] 10.222.0.104 () {56 vars in 1104 bytes} [Tue Aug 9 16:26:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 16:26:58.575852 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4c2509-09ac-47c3-be06-740ed24fd1d3 None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:58.618084 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12c6120-c122-436c-a99d-912aa2f7eac9 None None] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:58.662570 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747047d6-4165-46f7-a1c1-0bd70dfcfced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:58.663447 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747047d6-4165-46f7-a1c1-0bd70dfcfced None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:58.663871 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747047d6-4165-46f7-a1c1-0bd70dfcfced None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:58.665533 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747047d6-4165-46f7-a1c1-0bd70dfcfced None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:58.679732 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:58.687118 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747047d6-4165-46f7-a1c1-0bd70dfcfced None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 16:26:58.694254 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application [None req-747047d6-4165-46f7-a1c1-0bd70dfcfced None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 16:26:58.694254 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:26:58.694254 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:26:58.694254 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:26:58.694254 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:26:58.694254 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:26:58.694254 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:26:58.694254 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:26:58.694254 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:26:58.694254 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:26:58.694254 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:26:58.694254 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:26:58.694254 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 16:26:58.694254 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 16:26:58.694254 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 16:26:58.694254 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 16:26:58.695406 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 16:26:58.695406 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 16:26:58.695406 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 16:26:58.695406 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 16:26:58.695406 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:26:58.695406 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:26:58.695406 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:26:58.695406 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:26:58.695406 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:26:58.695406 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:26:58.695406 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:26:58.695406 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application with Lock( Aug 09 16:26:58.695406 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:26:58.695406 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:26:58.695406 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:26:58.695406 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:26:58.696384 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:26:58.696384 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:26:58.696384 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:26:58.696384 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:26:58.696384 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 16:26:58.696384 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 16:26:58.696384 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 16:26:58.696384 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 16:26:58.696384 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 16:26:58.696384 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 16:26:58.696384 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 16:26:58.696384 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Aug 09 16:26:58.702162 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 210/437] 10.222.0.104 () {56 vars in 1119 bytes} [Tue Aug 9 16:26:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 16:26:58.705574 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747047d6-4165-46f7-a1c1-0bd70dfcfced None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:58.719970 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4c2509-09ac-47c3-be06-740ed24fd1d3 None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:58.770730 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f67feb3-04d8-4f98-8553-29dcc89a394d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:58.771344 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f67feb3-04d8-4f98-8553-29dcc89a394d None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:58.771626 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f67feb3-04d8-4f98-8553-29dcc89a394d None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:58.771897 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f67feb3-04d8-4f98-8553-29dcc89a394d None admin] PATH_INFO: `/v3/roles` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:58.772576 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f67feb3-04d8-4f98-8553-29dcc89a394d None admin] RBAC: Adding query filter params (name=member) {{(pid=87275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:26:58.772877 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f67feb3-04d8-4f98-8553-29dcc89a394d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:58.774457 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f67feb3-04d8-4f98-8553-29dcc89a394d None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:58.789690 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 228/438] 10.222.0.104 () {56 vars in 1106 bytes} [Tue Aug 9 16:26:58 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:26:58.792215 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f67feb3-04d8-4f98-8553-29dcc89a394d None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:58.799352 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:58.865372 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747047d6-4165-46f7-a1c1-0bd70dfcfced None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:58.914825 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149e639f-1cd6-428a-bc03-fc8f7cbb8cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:58.915438 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149e639f-1cd6-428a-bc03-fc8f7cbb8cd7 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:58.915718 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149e639f-1cd6-428a-bc03-fc8f7cbb8cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:58.916301 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149e639f-1cd6-428a-bc03-fc8f7cbb8cd7 None admin] PATH_INFO: `/v3/roles` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:58.916701 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149e639f-1cd6-428a-bc03-fc8f7cbb8cd7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:26:58.917005 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149e639f-1cd6-428a-bc03-fc8f7cbb8cd7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:58.919203 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149e639f-1cd6-428a-bc03-fc8f7cbb8cd7 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:58.929196 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 211/439] 10.222.0.104 () {56 vars in 1116 bytes} [Tue Aug 9 16:26:58 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 16:26:58.930782 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f67feb3-04d8-4f98-8553-29dcc89a394d None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:58.935341 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149e639f-1cd6-428a-bc03-fc8f7cbb8cd7 None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:58.969172 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d05d46-7dac-427c-8ff0-e866d80333c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:58.970155 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d05d46-7dac-427c-8ff0-e866d80333c3 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:58.970660 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d05d46-7dac-427c-8ff0-e866d80333c3 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:58.971002 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d05d46-7dac-427c-8ff0-e866d80333c3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:58.981055 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:59.043384 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149e639f-1cd6-428a-bc03-fc8f7cbb8cd7 None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:59.048837 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d05d46-7dac-427c-8ff0-e866d80333c3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:59.050886 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d05d46-7dac-427c-8ff0-e866d80333c3 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:59.065162 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:59.081034 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ef4381-d98c-42cb-ad06-a0988a65e5ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:59.081877 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ef4381-d98c-42cb-ad06-a0988a65e5ee None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:59.082179 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ef4381-d98c-42cb-ad06-a0988a65e5ee None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:59.082449 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ef4381-d98c-42cb-ad06-a0988a65e5ee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:59.151276 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ef4381-d98c-42cb-ad06-a0988a65e5ee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:59.152725 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ef4381-d98c-42cb-ad06-a0988a65e5ee None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:59.162432 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 229/440] 10.222.0.104 () {58 vars in 1287 bytes} [Tue Aug 9 16:26:58 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 16:26:59.162432 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c7eec0-4b1a-4482-be94-887e652ffd9e None None] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:59.162432 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c7eec0-4b1a-4482-be94-887e652ffd9e None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:59.162432 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c7eec0-4b1a-4482-be94-887e652ffd9e None None] PATH_INFO: `/` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:59.162432 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 230/441] 10.222.0.104 () {54 vars in 932 bytes} [Tue Aug 9 16:26:59 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:26:59.163173 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f24a600-e5af-4e34-97a0-f7ea626f75eb None None] REQUEST_METHOD: `POST` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:59.163459 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f24a600-e5af-4e34-97a0-f7ea626f75eb None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:59.163735 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f24a600-e5af-4e34-97a0-f7ea626f75eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:59.181100 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.auth.core [None req-7f24a600-e5af-4e34-97a0-f7ea626f75eb None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:26:59.182348 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.fernet_utils [None req-7f24a600-e5af-4e34-97a0-f7ea626f75eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:26:59.212753 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:59.259206 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 231/442] 10.222.0.104 () {58 vars in 1029 bytes} [Tue Aug 9 16:26:59 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 16:26:59.259206 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f24a600-e5af-4e34-97a0-f7ea626f75eb None None] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:59.259454 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 212/443] 10.222.0.104 () {58 vars in 1287 bytes} [Tue Aug 9 16:26:58 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 09 16:26:59.259454 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ef4381-d98c-42cb-ad06-a0988a65e5ee None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:59.278649 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:59.350160 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f24a600-e5af-4e34-97a0-f7ea626f75eb None None] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:59.356487 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ef4381-d98c-42cb-ad06-a0988a65e5ee None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:59.383511 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f9f8c8-2839-4fcc-bb30-5a8cd6f1c861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:59.384218 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f9f8c8-2839-4fcc-bb30-5a8cd6f1c861 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:59.384501 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f9f8c8-2839-4fcc-bb30-5a8cd6f1c861 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:59.384785 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f9f8c8-2839-4fcc-bb30-5a8cd6f1c861 None admin] PATH_INFO: `/v3/projects/01f42016635a4e7ab655700eadbb1d93` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:59.385893 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f9f8c8-2839-4fcc-bb30-5a8cd6f1c861 None admin] RBAC: Authorizing `identity:get_project(project_id=01f42016635a4e7ab655700eadbb1d93)` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:59.387365 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f9f8c8-2839-4fcc-bb30-5a8cd6f1c861 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:59.389537 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 232/444] 10.222.0.104 () {56 vars in 1191 bytes} [Tue Aug 9 16:26:59 2022] GET /identity/v3/projects/01f42016635a4e7ab655700eadbb1d93 => generated 303 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:26:59.390410 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f9f8c8-2839-4fcc-bb30-5a8cd6f1c861 None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:59.391416 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eb79bd-2ba4-41ee-85c5-565e172c9240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:59.392243 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eb79bd-2ba4-41ee-85c5-565e172c9240 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:59.392729 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eb79bd-2ba4-41ee-85c5-565e172c9240 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:59.393004 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eb79bd-2ba4-41ee-85c5-565e172c9240 None admin] PATH_INFO: `/v3/projects/01f42016635a4e7ab655700eadbb1d93` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:59.394399 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34eb79bd-2ba4-41ee-85c5-565e172c9240 None admin] RBAC: Authorizing `identity:get_project(project_id=01f42016635a4e7ab655700eadbb1d93)` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:59.395818 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34eb79bd-2ba4-41ee-85c5-565e172c9240 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:59.397938 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 213/445] 10.222.0.104 () {56 vars in 1191 bytes} [Tue Aug 9 16:26:59 2022] GET /identity/v3/projects/01f42016635a4e7ab655700eadbb1d93 => generated 303 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 16:26:59.398219 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eb79bd-2ba4-41ee-85c5-565e172c9240 None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:59.428251 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:59.485564 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:59.493462 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f9f8c8-2839-4fcc-bb30-5a8cd6f1c861 None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:59.499590 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eb79bd-2ba4-41ee-85c5-565e172c9240 None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:59.530407 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef9846a-30c4-4f8c-9a9c-d2d62a510dca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:59.530963 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef9846a-30c4-4f8c-9a9c-d2d62a510dca None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:59.531241 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef9846a-30c4-4f8c-9a9c-d2d62a510dca None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:59.531513 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef9846a-30c4-4f8c-9a9c-d2d62a510dca None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:59.535496 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2613b6-26fd-4280-9ffb-6abb82f87e37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:59.536119 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2613b6-26fd-4280-9ffb-6abb82f87e37 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:59.536395 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2613b6-26fd-4280-9ffb-6abb82f87e37 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:59.536665 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2613b6-26fd-4280-9ffb-6abb82f87e37 None admin] PATH_INFO: `/v3/groups/3d825bb1f13649789718ba4a111c99b0` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:59.537775 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2613b6-26fd-4280-9ffb-6abb82f87e37 None admin] RBAC: Authorizing `identity:get_group(group_id=3d825bb1f13649789718ba4a111c99b0)` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:59.539233 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2613b6-26fd-4280-9ffb-6abb82f87e37 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:59.540804 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 214/446] 10.222.0.104 () {56 vars in 1185 bytes} [Tue Aug 9 16:26:59 2022] GET /identity/v3/groups/3d825bb1f13649789718ba4a111c99b0 => generated 227 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:26:59.541551 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef9846a-30c4-4f8c-9a9c-d2d62a510dca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 16:26:59.541654 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2613b6-26fd-4280-9ffb-6abb82f87e37 None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:59.547504 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application [None req-3ef9846a-30c4-4f8c-9a9c-d2d62a510dca None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 16:26:59.547504 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:26:59.547504 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:26:59.547504 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:26:59.547504 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:26:59.547504 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:26:59.547504 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:26:59.547504 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:26:59.547504 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:26:59.547504 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:26:59.547504 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:26:59.547504 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:26:59.547504 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 16:26:59.547504 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 16:26:59.547504 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 16:26:59.547504 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 16:26:59.548409 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 16:26:59.548409 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 16:26:59.548409 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 16:26:59.548409 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 16:26:59.548409 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:26:59.548409 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:26:59.548409 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:26:59.548409 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:26:59.548409 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:26:59.548409 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:26:59.548409 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:26:59.548409 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application with Lock( Aug 09 16:26:59.548409 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:26:59.548409 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:26:59.548409 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:26:59.548409 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:26:59.549193 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:26:59.549193 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:26:59.549193 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:26:59.549193 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:26:59.549193 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 16:26:59.549193 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 16:26:59.549193 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 16:26:59.549193 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 16:26:59.549193 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 16:26:59.549193 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 16:26:59.549193 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 16:26:59.549193 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Aug 09 16:26:59.549193 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 233/447] 10.222.0.104 () {56 vars in 1101 bytes} [Tue Aug 9 16:26:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 16:26:59.549855 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef9846a-30c4-4f8c-9a9c-d2d62a510dca None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:59.639825 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2613b6-26fd-4280-9ffb-6abb82f87e37 None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:59.644428 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:59.650832 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef9846a-30c4-4f8c-9a9c-d2d62a510dca None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:59.675433 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b0bfdc-5d07-4eba-9cc2-7c9ab0c9df81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:59.676167 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b0bfdc-5d07-4eba-9cc2-7c9ab0c9df81 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:59.676452 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b0bfdc-5d07-4eba-9cc2-7c9ab0c9df81 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:59.676729 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b0bfdc-5d07-4eba-9cc2-7c9ab0c9df81 None admin] PATH_INFO: `/v3/groups/3d825bb1f13649789718ba4a111c99b0` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:59.677983 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b0bfdc-5d07-4eba-9cc2-7c9ab0c9df81 None admin] RBAC: Authorizing `identity:get_group(group_id=3d825bb1f13649789718ba4a111c99b0)` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:59.679429 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b0bfdc-5d07-4eba-9cc2-7c9ab0c9df81 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:59.686944 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 215/448] 10.222.0.104 () {56 vars in 1185 bytes} [Tue Aug 9 16:26:59 2022] GET /identity/v3/groups/3d825bb1f13649789718ba4a111c99b0 => generated 227 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:26:59.686944 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b0bfdc-5d07-4eba-9cc2-7c9ab0c9df81 None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:59.689964 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76775440-7c94-4fa0-a68f-7f1423f4b4e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:59.690649 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76775440-7c94-4fa0-a68f-7f1423f4b4e3 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:59.690918 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76775440-7c94-4fa0-a68f-7f1423f4b4e3 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:59.691211 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76775440-7c94-4fa0-a68f-7f1423f4b4e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:59.691920 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76775440-7c94-4fa0-a68f-7f1423f4b4e3 None admin] RBAC: Adding query filter params (group.id=3d825bb1f13649789718ba4a111c99b0, role.id=044ca4f80141492b9c128ada543865e8, scope.project.id=01f42016635a4e7ab655700eadbb1d93) {{(pid=87275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:26:59.692226 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76775440-7c94-4fa0-a68f-7f1423f4b4e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:59.693698 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76775440-7c94-4fa0-a68f-7f1423f4b4e3 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:59.703028 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 234/449] 10.222.0.104 () {56 vars in 1381 bytes} [Tue Aug 9 16:26:59 2022] GET /identity/v3/role_assignments?group.id=3d825bb1f13649789718ba4a111c99b0&scope.project.id=01f42016635a4e7ab655700eadbb1d93&role.id=044ca4f80141492b9c128ada543865e8 => generated 613 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:26:59.703934 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76775440-7c94-4fa0-a68f-7f1423f4b4e3 None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:59.719835 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:26:59.815950 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b0bfdc-5d07-4eba-9cc2-7c9ab0c9df81 None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:59.832791 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76775440-7c94-4fa0-a68f-7f1423f4b4e3 None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:26:59.856130 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d3890c-4e6d-42e7-8786-df6f172150d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:59.857108 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d3890c-4e6d-42e7-8786-df6f172150d8 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:59.857611 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d3890c-4e6d-42e7-8786-df6f172150d8 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:59.858111 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d3890c-4e6d-42e7-8786-df6f172150d8 None admin] PATH_INFO: `/v3/roles` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:59.859523 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d3890c-4e6d-42e7-8786-df6f172150d8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:26:59.860229 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d3890c-4e6d-42e7-8786-df6f172150d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:59.862159 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d3890c-4e6d-42e7-8786-df6f172150d8 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:59.874058 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cb1a59-2e91-465f-a4c7-9ff4c92f4931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:26:59.874668 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cb1a59-2e91-465f-a4c7-9ff4c92f4931 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:26:59.874951 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cb1a59-2e91-465f-a4c7-9ff4c92f4931 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:26:59.875212 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cb1a59-2e91-465f-a4c7-9ff4c92f4931 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:26:59.875385 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 216/450] 10.222.0.104 () {56 vars in 1104 bytes} [Tue Aug 9 16:26:59 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:26:59.875949 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cb1a59-2e91-465f-a4c7-9ff4c92f4931 None admin] RBAC: Adding query filter params (group.id=3d825bb1f13649789718ba4a111c99b0, role.id=8a954d5b81f74df1985780d968ff3073, scope.project.id=01f42016635a4e7ab655700eadbb1d93) {{(pid=87275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:26:59.876242 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cb1a59-2e91-465f-a4c7-9ff4c92f4931 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:26:59.877715 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cb1a59-2e91-465f-a4c7-9ff4c92f4931 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:26:59.881023 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d3890c-4e6d-42e7-8786-df6f172150d8 None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:26:59.889963 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 235/451] 10.222.0.104 () {56 vars in 1381 bytes} [Tue Aug 9 16:26:59 2022] GET /identity/v3/role_assignments?group.id=3d825bb1f13649789718ba4a111c99b0&scope.project.id=01f42016635a4e7ab655700eadbb1d93&role.id=8a954d5b81f74df1985780d968ff3073 => generated 613 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:26:59.985550 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:00.003613 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d3890c-4e6d-42e7-8786-df6f172150d8 None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:00.044417 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732c51cc-1709-471f-a220-eb0a07b571ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:00.045057 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732c51cc-1709-471f-a220-eb0a07b571ff None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:00.045336 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732c51cc-1709-471f-a220-eb0a07b571ff None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:00.045613 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732c51cc-1709-471f-a220-eb0a07b571ff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:00.125867 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732c51cc-1709-471f-a220-eb0a07b571ff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:00.127587 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732c51cc-1709-471f-a220-eb0a07b571ff None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:00.229241 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:00.245400 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 217/452] 10.222.0.104 () {58 vars in 1287 bytes} [Tue Aug 9 16:26:59 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 09 16:27:00.251870 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cb1a59-2e91-465f-a4c7-9ff4c92f4931 None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:00.278070 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:00.351592 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cb1a59-2e91-465f-a4c7-9ff4c92f4931 None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:00.383991 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db10051-be11-4cc3-a260-6b9d171d33b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:00.384630 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db10051-be11-4cc3-a260-6b9d171d33b4 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:00.384946 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db10051-be11-4cc3-a260-6b9d171d33b4 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:00.385275 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db10051-be11-4cc3-a260-6b9d171d33b4 None admin] PATH_INFO: `/v3/projects/7ce95c8faa1d4165b111ca9c55852804` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:00.386701 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db10051-be11-4cc3-a260-6b9d171d33b4 None admin] RBAC: Authorizing `identity:get_project(project_id=7ce95c8faa1d4165b111ca9c55852804)` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:00.388431 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db10051-be11-4cc3-a260-6b9d171d33b4 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:00.390557 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 236/453] 10.222.0.104 () {56 vars in 1191 bytes} [Tue Aug 9 16:27:00 2022] GET /identity/v3/projects/7ce95c8faa1d4165b111ca9c55852804 => generated 345 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:27:00.396083 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732c51cc-1709-471f-a220-eb0a07b571ff None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:00.492498 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732c51cc-1709-471f-a220-eb0a07b571ff None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:00.525300 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74c50c4-c076-4593-b65a-560d12ecf11d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:00.525934 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74c50c4-c076-4593-b65a-560d12ecf11d None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:00.526226 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74c50c4-c076-4593-b65a-560d12ecf11d None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:00.526498 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74c50c4-c076-4593-b65a-560d12ecf11d None admin] PATH_INFO: `/v3/groups/00196bcbfe984dcdaf75768d99d04259` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:00.527600 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74c50c4-c076-4593-b65a-560d12ecf11d None admin] RBAC: Authorizing `identity:get_group(group_id=00196bcbfe984dcdaf75768d99d04259)` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:00.529074 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74c50c4-c076-4593-b65a-560d12ecf11d None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:00.531156 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 218/454] 10.222.0.104 () {56 vars in 1185 bytes} [Tue Aug 9 16:27:00 2022] GET /identity/v3/groups/00196bcbfe984dcdaf75768d99d04259 => generated 230 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:27:00.537107 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db10051-be11-4cc3-a260-6b9d171d33b4 None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:00.629998 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:00.639830 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db10051-be11-4cc3-a260-6b9d171d33b4 None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:00.671321 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1dc13e-8594-4846-b8ba-982e4a2aadb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:00.671909 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1dc13e-8594-4846-b8ba-982e4a2aadb0 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:00.672186 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1dc13e-8594-4846-b8ba-982e4a2aadb0 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:00.672456 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1dc13e-8594-4846-b8ba-982e4a2aadb0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:00.673169 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1dc13e-8594-4846-b8ba-982e4a2aadb0 None admin] RBAC: Adding query filter params (group.id=00196bcbfe984dcdaf75768d99d04259, role.id=c0143e35c1344a39a931bbb6bcd5acdc, scope.project.id=7ce95c8faa1d4165b111ca9c55852804) {{(pid=87275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:27:00.673474 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1dc13e-8594-4846-b8ba-982e4a2aadb0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:00.674926 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1dc13e-8594-4846-b8ba-982e4a2aadb0 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:00.680528 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 237/455] 10.222.0.104 () {56 vars in 1381 bytes} [Tue Aug 9 16:27:00 2022] GET /identity/v3/role_assignments?group.id=00196bcbfe984dcdaf75768d99d04259&scope.project.id=7ce95c8faa1d4165b111ca9c55852804&role.id=c0143e35c1344a39a931bbb6bcd5acdc => generated 613 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:27:03.349294 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd73714-4b69-4c58-a2d1-026467ea4963 None None] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:03.350203 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd73714-4b69-4c58-a2d1-026467ea4963 None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:03.350650 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd73714-4b69-4c58-a2d1-026467ea4963 None None] PATH_INFO: `/` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:03.352833 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 219/456] 10.222.0.104 () {54 vars in 932 bytes} [Tue Aug 9 16:27:03 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:27:03.360313 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86d389f-8245-4e2c-bb5e-2a1f442bdf87 None None] REQUEST_METHOD: `POST` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:03.361285 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86d389f-8245-4e2c-bb5e-2a1f442bdf87 None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:03.361756 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86d389f-8245-4e2c-bb5e-2a1f442bdf87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:03.381848 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.auth.core [None req-b86d389f-8245-4e2c-bb5e-2a1f442bdf87 None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:27:03.383425 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.fernet_utils [None req-b86d389f-8245-4e2c-bb5e-2a1f442bdf87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:27:03.423425 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891db9d0-ea93-4c5c-9c3f-7286bf4536fc None None] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:03.424061 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891db9d0-ea93-4c5c-9c3f-7286bf4536fc None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:03.424562 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891db9d0-ea93-4c5c-9c3f-7286bf4536fc None None] PATH_INFO: `/` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:03.426340 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 220/457] 10.222.0.104 () {54 vars in 932 bytes} [Tue Aug 9 16:27:03 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:27:03.431913 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88733517-9234-4849-8918-2674dd5df712 None None] REQUEST_METHOD: `POST` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:03.432699 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88733517-9234-4849-8918-2674dd5df712 None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:03.433171 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88733517-9234-4849-8918-2674dd5df712 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:03.452367 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.auth.core [None req-88733517-9234-4849-8918-2674dd5df712 None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:27:03.454158 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.fernet_utils [None req-88733517-9234-4849-8918-2674dd5df712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:27:03.455566 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 238/458] 10.222.0.104 () {58 vars in 1029 bytes} [Tue Aug 9 16:27:03 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 16:27:03.480928 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86d389f-8245-4e2c-bb5e-2a1f442bdf87 None None] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:03.508587 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:03.536956 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 221/459] 10.222.0.104 () {58 vars in 1029 bytes} [Tue Aug 9 16:27:03 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 16:27:03.562062 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88733517-9234-4849-8918-2674dd5df712 None None] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:03.574116 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:03.591150 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86d389f-8245-4e2c-bb5e-2a1f442bdf87 None None] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:03.626688 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfcfb16-42d5-45fd-90b1-d6f96d0c8ccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:03.627224 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfcfb16-42d5-45fd-90b1-d6f96d0c8ccb None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:03.627506 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfcfb16-42d5-45fd-90b1-d6f96d0c8ccb None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:03.627782 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfcfb16-42d5-45fd-90b1-d6f96d0c8ccb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:03.640009 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfcfb16-42d5-45fd-90b1-d6f96d0c8ccb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:03.641568 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfcfb16-42d5-45fd-90b1-d6f96d0c8ccb None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:03.657411 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application [None req-ccfcfb16-42d5-45fd-90b1-d6f96d0c8ccb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 16:27:03.657411 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:27:03.657411 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:27:03.657411 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:27:03.657411 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:27:03.657411 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:27:03.657411 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:27:03.657411 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:27:03.657411 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:27:03.657411 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:27:03.657411 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:27:03.657411 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:27:03.657411 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 16:27:03.657411 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 16:27:03.657411 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 16:27:03.657411 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 16:27:03.658584 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:27:03.658584 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:27:03.658584 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:27:03.658584 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:27:03.658584 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:27:03.658584 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:27:03.658584 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:27:03.658584 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application with Lock( Aug 09 16:27:03.658584 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:27:03.658584 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:27:03.658584 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:27:03.658584 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:27:03.658584 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:27:03.658584 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:27:03.658584 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:27:03.658584 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:27:03.658584 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 16:27:03.659824 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 16:27:03.659824 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 16:27:03.659824 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Aug 09 16:27:03.659824 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 239/460] 10.222.0.104 () {56 vars in 1113 bytes} [Tue Aug 9 16:27:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 16:27:03.660193 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46320433-7f74-4214-bf86-ef65632298c5 None None] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:03.660480 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46320433-7f74-4214-bf86-ef65632298c5 None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:03.660776 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46320433-7f74-4214-bf86-ef65632298c5 None None] PATH_INFO: `/` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:03.662185 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 240/461] 10.222.0.104 () {54 vars in 932 bytes} [Tue Aug 9 16:27:03 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:27:03.667162 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46320433-7f74-4214-bf86-ef65632298c5 None None] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:03.681276 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88733517-9234-4849-8918-2674dd5df712 None None] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:03.725238 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f055776-35f9-44bf-a424-6a9db5b601d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:03.725869 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f055776-35f9-44bf-a424-6a9db5b601d2 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:03.726180 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f055776-35f9-44bf-a424-6a9db5b601d2 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:03.726457 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f055776-35f9-44bf-a424-6a9db5b601d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:03.736580 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f055776-35f9-44bf-a424-6a9db5b601d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:03.738060 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f055776-35f9-44bf-a424-6a9db5b601d2 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:03.753253 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application [None req-5f055776-35f9-44bf-a424-6a9db5b601d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 16:27:03.753253 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:27:03.753253 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:27:03.753253 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:27:03.753253 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:27:03.753253 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:27:03.753253 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:27:03.753253 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:27:03.753253 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:27:03.753253 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:27:03.753253 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:27:03.753253 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:27:03.753253 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 16:27:03.753253 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 16:27:03.753253 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 16:27:03.753253 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 16:27:03.754246 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:27:03.754246 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:27:03.754246 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:27:03.754246 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:27:03.754246 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:27:03.754246 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:27:03.754246 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:27:03.754246 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application with Lock( Aug 09 16:27:03.754246 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:27:03.754246 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:27:03.754246 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:27:03.754246 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:27:03.754246 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:27:03.754246 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:27:03.754246 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:27:03.754246 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:27:03.754246 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 16:27:03.755094 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 16:27:03.755094 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 16:27:03.755094 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Aug 09 16:27:03.755094 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 222/462] 10.222.0.104 () {56 vars in 1113 bytes} [Tue Aug 9 16:27:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 16:27:03.755801 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9ad78e-02ce-4a10-a54c-ea8646c78af9 None None] REQUEST_METHOD: `POST` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:03.755801 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9ad78e-02ce-4a10-a54c-ea8646c78af9 None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:03.756046 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9ad78e-02ce-4a10-a54c-ea8646c78af9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:03.782820 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.auth.core [None req-df9ad78e-02ce-4a10-a54c-ea8646c78af9 None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:27:03.784400 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.fernet_utils [None req-df9ad78e-02ce-4a10-a54c-ea8646c78af9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:27:03.784922 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46320433-7f74-4214-bf86-ef65632298c5 None None] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:03.817066 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:03.822790 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87215b71-0b6a-4581-9b7f-5b774c4eebcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:03.823377 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87215b71-0b6a-4581-9b7f-5b774c4eebcc None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:03.823656 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87215b71-0b6a-4581-9b7f-5b774c4eebcc None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:03.823929 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87215b71-0b6a-4581-9b7f-5b774c4eebcc None admin] PATH_INFO: `/v3/domains` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:03.824569 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87215b71-0b6a-4581-9b7f-5b774c4eebcc None admin] RBAC: Adding query filter params (name=Default) {{(pid=87275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:27:03.824877 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87215b71-0b6a-4581-9b7f-5b774c4eebcc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:03.826824 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87215b71-0b6a-4581-9b7f-5b774c4eebcc None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:03.833449 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:03.839645 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 241/463] 10.222.0.104 () {56 vars in 1114 bytes} [Tue Aug 9 16:27:03 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:27:03.844880 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87215b71-0b6a-4581-9b7f-5b774c4eebcc None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:03.869347 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 223/464] 10.222.0.104 () {58 vars in 1029 bytes} [Tue Aug 9 16:27:03 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 16:27:03.869347 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9ad78e-02ce-4a10-a54c-ea8646c78af9 None None] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:03.952619 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87215b71-0b6a-4581-9b7f-5b774c4eebcc None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:03.973102 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9ad78e-02ce-4a10-a54c-ea8646c78af9 None None] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:03.985390 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82df64cc-e5d3-41a3-8051-976dbd93ab2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:03.986033 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82df64cc-e5d3-41a3-8051-976dbd93ab2f None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:03.986368 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82df64cc-e5d3-41a3-8051-976dbd93ab2f None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:03.986635 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82df64cc-e5d3-41a3-8051-976dbd93ab2f None admin] PATH_INFO: `/v3/domains` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:03.987267 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82df64cc-e5d3-41a3-8051-976dbd93ab2f None admin] RBAC: Adding query filter params (name=Default) {{(pid=87275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:27:03.987562 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82df64cc-e5d3-41a3-8051-976dbd93ab2f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:03.988915 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82df64cc-e5d3-41a3-8051-976dbd93ab2f None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:04.001334 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 242/465] 10.222.0.104 () {56 vars in 1114 bytes} [Tue Aug 9 16:27:03 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:27:04.002509 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806bece7-7fcd-4d6c-b0d8-282bce5b7cff None None] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:04.002781 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806bece7-7fcd-4d6c-b0d8-282bce5b7cff None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:04.003056 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806bece7-7fcd-4d6c-b0d8-282bce5b7cff None None] PATH_INFO: `/` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:04.004222 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 243/466] 10.222.0.104 () {54 vars in 932 bytes} [Tue Aug 9 16:27:04 2022] GET /identity => generated 271 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:27:04.007396 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d261861-8af1-45b0-877b-57bc30f956b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:04.007999 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d261861-8af1-45b0-877b-57bc30f956b8 None admin] REQUEST_METHOD: `POST` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:04.008282 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d261861-8af1-45b0-877b-57bc30f956b8 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:04.008549 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d261861-8af1-45b0-877b-57bc30f956b8 None admin] PATH_INFO: `/v3/users` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:04.008653 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806bece7-7fcd-4d6c-b0d8-282bce5b7cff None None] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:04.009188 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d261861-8af1-45b0-877b-57bc30f956b8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:04.010641 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d261861-8af1-45b0-877b-57bc30f956b8 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:04.032959 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 224/467] 10.222.0.104 () {60 vars in 1137 bytes} [Tue Aug 9 16:27:03 2022] POST /identity/v3/users => generated 247 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 16:27:04.034004 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d261861-8af1-45b0-877b-57bc30f956b8 None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:04.068382 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:04.101502 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:04.157745 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806bece7-7fcd-4d6c-b0d8-282bce5b7cff None None] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:04.164152 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d261861-8af1-45b0-877b-57bc30f956b8 None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:04.199039 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f9192d-f437-43c1-9275-a2968df9e20c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:04.199678 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f9192d-f437-43c1-9275-a2968df9e20c None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:04.200515 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f9192d-f437-43c1-9275-a2968df9e20c None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:04.200741 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f9192d-f437-43c1-9275-a2968df9e20c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:04.203205 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de1a91e-1d3b-40a6-9296-51f441e93575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:04.204155 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de1a91e-1d3b-40a6-9296-51f441e93575 None admin] REQUEST_METHOD: `POST` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:04.204441 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de1a91e-1d3b-40a6-9296-51f441e93575 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:04.204747 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de1a91e-1d3b-40a6-9296-51f441e93575 None admin] PATH_INFO: `/v3/users` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:04.205402 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de1a91e-1d3b-40a6-9296-51f441e93575 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:04.206934 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de1a91e-1d3b-40a6-9296-51f441e93575 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:04.212134 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f9192d-f437-43c1-9275-a2968df9e20c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:04.213661 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f9192d-f437-43c1-9275-a2968df9e20c None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:04.231962 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application [None req-e3f9192d-f437-43c1-9275-a2968df9e20c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 16:27:04.231962 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:27:04.231962 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:27:04.231962 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:27:04.231962 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:27:04.231962 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:27:04.231962 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:27:04.231962 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:27:04.231962 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:27:04.231962 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:27:04.231962 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:27:04.231962 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:27:04.231962 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 16:27:04.231962 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 16:27:04.231962 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 16:27:04.231962 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 16:27:04.233014 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:27:04.233014 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:27:04.233014 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:27:04.233014 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:27:04.233014 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:27:04.233014 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:27:04.233014 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:27:04.233014 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application with Lock( Aug 09 16:27:04.233014 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:27:04.233014 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:27:04.233014 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:27:04.233014 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:27:04.233014 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:27:04.233014 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:27:04.233014 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:27:04.233014 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:27:04.233014 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 16:27:04.234004 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 16:27:04.234004 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 16:27:04.234004 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Aug 09 16:27:04.234167 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 225/468] 10.222.0.104 () {60 vars in 1137 bytes} [Tue Aug 9 16:27:04 2022] POST /identity/v3/users => generated 249 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 16:27:04.235859 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 244/469] 10.222.0.104 () {56 vars in 1113 bytes} [Tue Aug 9 16:27:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 16:27:04.239330 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2930c1f-60a2-4076-9376-239c919af80c None None] REQUEST_METHOD: `POST` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:04.239623 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2930c1f-60a2-4076-9376-239c919af80c None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:04.239888 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2930c1f-60a2-4076-9376-239c919af80c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:04.243053 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f9192d-f437-43c1-9275-a2968df9e20c None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:04.263100 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.auth.core [None req-e2930c1f-60a2-4076-9376-239c919af80c None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:27:04.264491 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.fernet_utils [None req-e2930c1f-60a2-4076-9376-239c919af80c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:27:04.366232 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 226/470] 10.222.0.104 () {58 vars in 1029 bytes} [Tue Aug 9 16:27:04 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 16:27:04.383875 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f9192d-f437-43c1-9275-a2968df9e20c None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:04.395257 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2930c1f-60a2-4076-9376-239c919af80c None None] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:04.398865 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:04.407336 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:04.436193 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb461f62-f3df-4863-833f-74a603d517fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:04.437318 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb461f62-f3df-4863-833f-74a603d517fc None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:04.437778 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb461f62-f3df-4863-833f-74a603d517fc None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:04.439074 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb461f62-f3df-4863-833f-74a603d517fc None admin] PATH_INFO: `/v3/domains` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:04.439911 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb461f62-f3df-4863-833f-74a603d517fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=87275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:27:04.440219 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb461f62-f3df-4863-833f-74a603d517fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:04.441622 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb461f62-f3df-4863-833f-74a603d517fc None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:04.455877 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 245/471] 10.222.0.104 () {56 vars in 1114 bytes} [Tue Aug 9 16:27:04 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:27:04.460938 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb461f62-f3df-4863-833f-74a603d517fc None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:04.530972 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2930c1f-60a2-4076-9376-239c919af80c None None] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:04.581500 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb461f62-f3df-4863-833f-74a603d517fc None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:04.583988 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3746623d-0cc4-45b7-90cf-4df28cfcd704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:04.585611 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3746623d-0cc4-45b7-90cf-4df28cfcd704 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:04.586108 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3746623d-0cc4-45b7-90cf-4df28cfcd704 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:04.586457 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3746623d-0cc4-45b7-90cf-4df28cfcd704 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:04.599971 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3746623d-0cc4-45b7-90cf-4df28cfcd704 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:04.602567 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3746623d-0cc4-45b7-90cf-4df28cfcd704 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:04.619670 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019676ea-2264-4f53-a09e-1aaa31246263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:04.620544 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019676ea-2264-4f53-a09e-1aaa31246263 None admin] REQUEST_METHOD: `POST` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:04.620969 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019676ea-2264-4f53-a09e-1aaa31246263 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:04.621410 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019676ea-2264-4f53-a09e-1aaa31246263 None admin] PATH_INFO: `/v3/users` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:04.622793 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019676ea-2264-4f53-a09e-1aaa31246263 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:04.623627 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application [None req-3746623d-0cc4-45b7-90cf-4df28cfcd704 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 16:27:04.623627 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:27:04.623627 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:27:04.623627 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:27:04.623627 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:27:04.623627 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:27:04.623627 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:27:04.623627 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:27:04.623627 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:27:04.623627 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:27:04.623627 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:27:04.623627 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:27:04.623627 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 16:27:04.623627 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 16:27:04.623627 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 16:27:04.623627 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 16:27:04.624604 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:27:04.624604 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:27:04.624604 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:27:04.624604 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:27:04.624604 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:27:04.624604 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:27:04.624604 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:27:04.624604 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application with Lock( Aug 09 16:27:04.624604 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:27:04.624604 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:27:04.624604 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:27:04.624604 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:27:04.624604 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:27:04.624604 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:27:04.624604 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:27:04.624604 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:27:04.624604 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 16:27:04.625436 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 16:27:04.625436 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 16:27:04.625436 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Aug 09 16:27:04.625436 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 227/472] 10.222.0.104 () {56 vars in 1113 bytes} [Tue Aug 9 16:27:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 16:27:04.631207 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019676ea-2264-4f53-a09e-1aaa31246263 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:04.631841 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3746623d-0cc4-45b7-90cf-4df28cfcd704 None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:04.657828 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 246/473] 10.222.0.104 () {60 vars in 1137 bytes} [Tue Aug 9 16:27:04 2022] POST /identity/v3/users => generated 249 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 16:27:04.709563 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:04.758152 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3746623d-0cc4-45b7-90cf-4df28cfcd704 None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:04.797439 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1478eba-391d-4632-8c0a-aa6da45793b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:04.798090 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1478eba-391d-4632-8c0a-aa6da45793b0 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:04.798370 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1478eba-391d-4632-8c0a-aa6da45793b0 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:04.798641 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1478eba-391d-4632-8c0a-aa6da45793b0 None admin] PATH_INFO: `/v3/domains` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:04.799302 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1478eba-391d-4632-8c0a-aa6da45793b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:27:04.799605 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1478eba-391d-4632-8c0a-aa6da45793b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:04.801059 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1478eba-391d-4632-8c0a-aa6da45793b0 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:04.821650 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 228/474] 10.222.0.104 () {56 vars in 1114 bytes} [Tue Aug 9 16:27:04 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 16:27:04.827837 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019676ea-2264-4f53-a09e-1aaa31246263 None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:04.865312 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:04.952458 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019676ea-2264-4f53-a09e-1aaa31246263 None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:04.992028 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368a6935-c4ba-4420-8a14-5af6f967fb08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:04.992560 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368a6935-c4ba-4420-8a14-5af6f967fb08 None admin] REQUEST_METHOD: `POST` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:04.992840 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368a6935-c4ba-4420-8a14-5af6f967fb08 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:04.993113 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368a6935-c4ba-4420-8a14-5af6f967fb08 None admin] PATH_INFO: `/v3/users` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:04.993767 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368a6935-c4ba-4420-8a14-5af6f967fb08 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:04.995249 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368a6935-c4ba-4420-8a14-5af6f967fb08 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:05.018389 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 247/475] 10.222.0.104 () {60 vars in 1137 bytes} [Tue Aug 9 16:27:04 2022] POST /identity/v3/users => generated 250 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 16:27:06.494949 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd084fc-936d-4e7f-9d68-0ffb143f11ea None None] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:06.495469 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd084fc-936d-4e7f-9d68-0ffb143f11ea None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:06.495469 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd084fc-936d-4e7f-9d68-0ffb143f11ea None None] PATH_INFO: `/` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:06.497667 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 229/476] 10.222.0.104 () {54 vars in 932 bytes} [Tue Aug 9 16:27:06 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:27:06.503201 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442b66e3-a2f2-44a8-bab8-661ec829925e None None] REQUEST_METHOD: `POST` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:06.503625 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442b66e3-a2f2-44a8-bab8-661ec829925e None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:06.503795 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442b66e3-a2f2-44a8-bab8-661ec829925e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:06.522524 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.auth.core [None req-442b66e3-a2f2-44a8-bab8-661ec829925e None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:27:06.523700 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.fernet_utils [None req-442b66e3-a2f2-44a8-bab8-661ec829925e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:27:06.598010 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 248/477] 10.222.0.104 () {58 vars in 1029 bytes} [Tue Aug 9 16:27:06 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 16:27:06.616087 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd084fc-936d-4e7f-9d68-0ffb143f11ea None None] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:06.702738 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b40299f-c5e2-4e49-af19-8a378a9f8702 None None] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:06.703079 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b40299f-c5e2-4e49-af19-8a378a9f8702 None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:06.703288 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b40299f-c5e2-4e49-af19-8a378a9f8702 None None] PATH_INFO: `/` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:06.708509 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 249/478] 10.222.0.104 () {54 vars in 932 bytes} [Tue Aug 9 16:27:06 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 09 16:27:06.710132 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78048bb-77ba-4d42-b561-11b37867d73a None None] REQUEST_METHOD: `POST` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:06.710416 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78048bb-77ba-4d42-b561-11b37867d73a None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:06.710688 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78048bb-77ba-4d42-b561-11b37867d73a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:06.722126 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd084fc-936d-4e7f-9d68-0ffb143f11ea None None] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:06.728752 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.auth.core [None req-d78048bb-77ba-4d42-b561-11b37867d73a None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:27:06.730132 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.fernet_utils [None req-d78048bb-77ba-4d42-b561-11b37867d73a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:27:06.738399 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:06.743521 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:06.766019 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9bb84e-5fdb-45fb-8a7e-386f39122fa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:06.766656 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9bb84e-5fdb-45fb-8a7e-386f39122fa9 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:06.766928 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9bb84e-5fdb-45fb-8a7e-386f39122fa9 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:06.767184 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9bb84e-5fdb-45fb-8a7e-386f39122fa9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:06.780412 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9bb84e-5fdb-45fb-8a7e-386f39122fa9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 16:27:06.785355 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application [None req-8b9bb84e-5fdb-45fb-8a7e-386f39122fa9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 16:27:06.785355 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:27:06.785355 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:27:06.785355 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:27:06.785355 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:27:06.785355 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:27:06.785355 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:27:06.785355 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:27:06.785355 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:27:06.785355 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:27:06.785355 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:27:06.785355 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:27:06.785355 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 16:27:06.785355 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 16:27:06.785355 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 16:27:06.785355 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 16:27:06.786278 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 16:27:06.786278 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 16:27:06.786278 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 16:27:06.786278 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 16:27:06.786278 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:27:06.786278 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:27:06.786278 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:27:06.786278 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:27:06.786278 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:27:06.786278 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:27:06.786278 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:27:06.786278 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application with Lock( Aug 09 16:27:06.786278 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:27:06.786278 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:27:06.786278 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:27:06.786278 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:27:06.787080 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:27:06.787080 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:27:06.787080 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:27:06.787080 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:27:06.787080 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 16:27:06.787080 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 16:27:06.787080 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 16:27:06.787080 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 16:27:06.787080 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 16:27:06.787080 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 16:27:06.787080 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 16:27:06.787080 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Aug 09 16:27:06.789653 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 230/479] 10.222.0.104 () {56 vars in 1107 bytes} [Tue Aug 9 16:27:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 16:27:06.796688 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9bb84e-5fdb-45fb-8a7e-386f39122fa9 None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:06.819855 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 250/480] 10.222.0.104 () {58 vars in 1029 bytes} [Tue Aug 9 16:27:06 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 16:27:06.844589 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78048bb-77ba-4d42-b561-11b37867d73a None None] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:06.926443 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9bb84e-5fdb-45fb-8a7e-386f39122fa9 None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:06.960826 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78048bb-77ba-4d42-b561-11b37867d73a None None] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:06.976387 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5ea99d-f23b-4f9b-b2fc-d604f0c2f3ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:06.977391 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5ea99d-f23b-4f9b-b2fc-d604f0c2f3ea None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:06.978207 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5ea99d-f23b-4f9b-b2fc-d604f0c2f3ea None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:06.978624 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5ea99d-f23b-4f9b-b2fc-d604f0c2f3ea None admin] PATH_INFO: `/v3/roles` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:06.979773 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5ea99d-f23b-4f9b-b2fc-d604f0c2f3ea None admin] RBAC: Adding query filter params (name=service) {{(pid=87276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:27:06.980295 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5ea99d-f23b-4f9b-b2fc-d604f0c2f3ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:06.982868 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5ea99d-f23b-4f9b-b2fc-d604f0c2f3ea None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:06.997830 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 231/481] 10.222.0.104 () {56 vars in 1108 bytes} [Tue Aug 9 16:27:06 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:27:07.004174 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5ea99d-f23b-4f9b-b2fc-d604f0c2f3ea None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:07.005518 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905edabc-28a4-4ffa-9c88-39b5a2493326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:07.006476 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905edabc-28a4-4ffa-9c88-39b5a2493326 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:07.006851 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905edabc-28a4-4ffa-9c88-39b5a2493326 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:07.007213 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905edabc-28a4-4ffa-9c88-39b5a2493326 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:07.023863 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905edabc-28a4-4ffa-9c88-39b5a2493326 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 16:27:07.030084 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application [None req-905edabc-28a4-4ffa-9c88-39b5a2493326 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 16:27:07.030084 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:27:07.030084 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:27:07.030084 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:27:07.030084 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:27:07.030084 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:27:07.030084 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:27:07.030084 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:27:07.030084 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:27:07.030084 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:27:07.030084 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:27:07.030084 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:27:07.030084 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 16:27:07.030084 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 16:27:07.030084 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 16:27:07.030084 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 16:27:07.030989 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 16:27:07.030989 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 16:27:07.030989 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 16:27:07.030989 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 16:27:07.030989 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:27:07.030989 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:27:07.030989 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:27:07.030989 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:27:07.030989 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:27:07.030989 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:27:07.030989 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:27:07.030989 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application with Lock( Aug 09 16:27:07.030989 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:27:07.030989 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:27:07.030989 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:27:07.030989 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:27:07.032212 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:27:07.032212 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:27:07.032212 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:27:07.032212 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:27:07.032212 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 16:27:07.032212 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 16:27:07.032212 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 16:27:07.032212 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 16:27:07.032212 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 16:27:07.032212 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 16:27:07.032212 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 16:27:07.032212 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Aug 09 16:27:07.036534 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 251/482] 10.222.0.104 () {56 vars in 1107 bytes} [Tue Aug 9 16:27:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 16:27:07.037568 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905edabc-28a4-4ffa-9c88-39b5a2493326 None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:07.041992 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:07.069505 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:07.137723 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5ea99d-f23b-4f9b-b2fc-d604f0c2f3ea None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:07.173435 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905edabc-28a4-4ffa-9c88-39b5a2493326 None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:07.175269 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922aeceb-52bc-4160-9c80-99d2d7bf0945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:07.176720 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922aeceb-52bc-4160-9c80-99d2d7bf0945 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:07.177007 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922aeceb-52bc-4160-9c80-99d2d7bf0945 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:07.177282 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922aeceb-52bc-4160-9c80-99d2d7bf0945 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:07.191313 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922aeceb-52bc-4160-9c80-99d2d7bf0945 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:07.192772 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922aeceb-52bc-4160-9c80-99d2d7bf0945 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:07.207349 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application [None req-922aeceb-52bc-4160-9c80-99d2d7bf0945 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 16:27:07.207349 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:27:07.207349 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:27:07.207349 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:27:07.207349 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:27:07.207349 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:27:07.207349 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:27:07.207349 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:27:07.207349 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:27:07.207349 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:27:07.207349 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:27:07.207349 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:27:07.207349 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 16:27:07.207349 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 16:27:07.207349 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 16:27:07.207349 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 16:27:07.208266 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:27:07.208266 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:27:07.208266 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:27:07.208266 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:27:07.208266 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:27:07.208266 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:27:07.208266 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:27:07.208266 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application with Lock( Aug 09 16:27:07.208266 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:27:07.208266 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:27:07.208266 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:27:07.208266 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:27:07.208266 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:27:07.208266 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:27:07.208266 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:27:07.208266 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:27:07.208266 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 16:27:07.213872 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 16:27:07.213872 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 16:27:07.213872 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Aug 09 16:27:07.213872 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 232/483] 10.222.0.104 () {56 vars in 1113 bytes} [Tue Aug 9 16:27:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 16:27:07.213872 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2a69a5-5194-4c82-8326-57666e9a6eac None None] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:07.213872 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2a69a5-5194-4c82-8326-57666e9a6eac None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:07.213872 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2a69a5-5194-4c82-8326-57666e9a6eac None None] PATH_INFO: `/` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:07.213872 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 233/484] 10.222.0.104 () {54 vars in 932 bytes} [Tue Aug 9 16:27:07 2022] GET /identity => generated 271 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:27:07.215730 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2a69a5-5194-4c82-8326-57666e9a6eac None None] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:07.217505 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5542e0f-27a1-42c0-ade6-09881b3f34f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:07.218153 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5542e0f-27a1-42c0-ade6-09881b3f34f6 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:07.218433 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5542e0f-27a1-42c0-ade6-09881b3f34f6 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:07.218822 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5542e0f-27a1-42c0-ade6-09881b3f34f6 None admin] PATH_INFO: `/v3/roles` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:07.219371 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5542e0f-27a1-42c0-ade6-09881b3f34f6 None admin] RBAC: Adding query filter params (name=service) {{(pid=87275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:27:07.220445 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5542e0f-27a1-42c0-ade6-09881b3f34f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:07.221045 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5542e0f-27a1-42c0-ade6-09881b3f34f6 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:07.234873 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 252/485] 10.222.0.104 () {56 vars in 1108 bytes} [Tue Aug 9 16:27:07 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:27:07.234873 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0de4268-d73c-40de-ac18-fe2fe8002dd7 None None] REQUEST_METHOD: `POST` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:07.234873 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0de4268-d73c-40de-ac18-fe2fe8002dd7 None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:07.234873 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0de4268-d73c-40de-ac18-fe2fe8002dd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:07.251482 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.auth.core [None req-d0de4268-d73c-40de-ac18-fe2fe8002dd7 None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:27:07.252747 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.fernet_utils [None req-d0de4268-d73c-40de-ac18-fe2fe8002dd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:27:07.321242 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:07.330110 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:07.338276 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 253/486] 10.222.0.104 () {58 vars in 1029 bytes} [Tue Aug 9 16:27:07 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 16:27:07.338276 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0de4268-d73c-40de-ac18-fe2fe8002dd7 None None] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:07.346167 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2a69a5-5194-4c82-8326-57666e9a6eac None None] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:07.385104 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d964fc8c-f49d-4e17-8be7-fd11e1435de2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:07.385846 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d964fc8c-f49d-4e17-8be7-fd11e1435de2 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:07.386255 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d964fc8c-f49d-4e17-8be7-fd11e1435de2 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:07.386623 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d964fc8c-f49d-4e17-8be7-fd11e1435de2 None admin] PATH_INFO: `/v3/domains` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:07.387395 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d964fc8c-f49d-4e17-8be7-fd11e1435de2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:27:07.387783 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d964fc8c-f49d-4e17-8be7-fd11e1435de2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:07.389218 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d964fc8c-f49d-4e17-8be7-fd11e1435de2 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:07.407798 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 234/487] 10.222.0.104 () {56 vars in 1114 bytes} [Tue Aug 9 16:27:07 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 16:27:07.407798 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d964fc8c-f49d-4e17-8be7-fd11e1435de2 None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:07.457415 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0de4268-d73c-40de-ac18-fe2fe8002dd7 None None] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:07.493297 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea739b92-e042-40d0-a45d-95bdbcc52322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:07.493952 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea739b92-e042-40d0-a45d-95bdbcc52322 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:07.494246 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea739b92-e042-40d0-a45d-95bdbcc52322 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:07.494568 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea739b92-e042-40d0-a45d-95bdbcc52322 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:07.504525 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea739b92-e042-40d0-a45d-95bdbcc52322 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:07.506088 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea739b92-e042-40d0-a45d-95bdbcc52322 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:07.511158 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d964fc8c-f49d-4e17-8be7-fd11e1435de2 None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:07.520374 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application [None req-ea739b92-e042-40d0-a45d-95bdbcc52322 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 16:27:07.520374 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:27:07.520374 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:27:07.520374 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:27:07.520374 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:27:07.520374 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:27:07.520374 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:27:07.520374 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:27:07.520374 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:27:07.520374 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:27:07.520374 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:27:07.520374 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:27:07.520374 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 16:27:07.520374 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 16:27:07.520374 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 16:27:07.520374 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 16:27:07.521452 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:27:07.521452 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:27:07.521452 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:27:07.521452 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:27:07.521452 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:27:07.521452 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:27:07.521452 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:27:07.521452 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application with Lock( Aug 09 16:27:07.521452 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:27:07.521452 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:27:07.521452 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:27:07.521452 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:27:07.521452 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:27:07.521452 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:27:07.521452 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:27:07.521452 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:27:07.521452 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 16:27:07.522345 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 16:27:07.522345 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 16:27:07.522345 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Aug 09 16:27:07.522345 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 254/488] 10.222.0.104 () {56 vars in 1113 bytes} [Tue Aug 9 16:27:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 16:27:07.522345 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea739b92-e042-40d0-a45d-95bdbcc52322 None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:07.549335 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7566dff-b578-41e2-912f-82d57cfd02ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:07.550101 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7566dff-b578-41e2-912f-82d57cfd02ab None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:07.550380 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7566dff-b578-41e2-912f-82d57cfd02ab None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:07.550650 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7566dff-b578-41e2-912f-82d57cfd02ab None admin] PATH_INFO: `/v3/roles/service` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:07.562785 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7566dff-b578-41e2-912f-82d57cfd02ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 16:27:07.567530 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application [None req-d7566dff-b578-41e2-912f-82d57cfd02ab None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 16:27:07.567530 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:27:07.567530 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:27:07.567530 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:27:07.567530 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:27:07.567530 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:27:07.567530 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:27:07.567530 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:27:07.567530 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:27:07.567530 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:27:07.567530 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:27:07.567530 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:27:07.567530 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 16:27:07.567530 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 16:27:07.567530 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 16:27:07.567530 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 16:27:07.568577 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 16:27:07.568577 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 16:27:07.568577 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 16:27:07.568577 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 16:27:07.568577 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:27:07.568577 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:27:07.568577 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:27:07.568577 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:27:07.568577 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:27:07.568577 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:27:07.568577 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:27:07.568577 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application with Lock( Aug 09 16:27:07.568577 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:27:07.568577 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:27:07.568577 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:27:07.568577 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:27:07.569579 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:27:07.569579 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:27:07.569579 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:27:07.569579 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:27:07.569579 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 16:27:07.569579 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 16:27:07.569579 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 16:27:07.569579 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 16:27:07.569579 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 16:27:07.569579 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 16:27:07.569579 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 16:27:07.569579 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Aug 09 16:27:07.570386 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 235/489] 10.222.0.104 () {56 vars in 1107 bytes} [Tue Aug 9 16:27:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 16:27:07.571066 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:07.571331 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3944a2-2b25-48db-9d65-294510cfaf72 None None] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:07.571643 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3944a2-2b25-48db-9d65-294510cfaf72 None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:07.572094 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3944a2-2b25-48db-9d65-294510cfaf72 None None] PATH_INFO: `/` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:07.573779 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 236/490] 10.222.0.104 () {54 vars in 932 bytes} [Tue Aug 9 16:27:07 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:27:07.574973 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3944a2-2b25-48db-9d65-294510cfaf72 None None] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:07.591343 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:07.631601 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea739b92-e042-40d0-a45d-95bdbcc52322 None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:07.664497 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be7ef8b-af32-4183-86ce-c3d70d9786d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:07.665114 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be7ef8b-af32-4183-86ce-c3d70d9786d1 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:07.665387 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be7ef8b-af32-4183-86ce-c3d70d9786d1 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:07.665658 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be7ef8b-af32-4183-86ce-c3d70d9786d1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:07.673791 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be7ef8b-af32-4183-86ce-c3d70d9786d1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:07.675298 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be7ef8b-af32-4183-86ce-c3d70d9786d1 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:07.677856 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3944a2-2b25-48db-9d65-294510cfaf72 None None] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:07.687745 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application [None req-1be7ef8b-af32-4183-86ce-c3d70d9786d1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 09 16:27:07.687745 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:27:07.687745 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:27:07.687745 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:27:07.687745 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:27:07.687745 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:27:07.687745 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:27:07.687745 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:27:07.687745 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:27:07.687745 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:27:07.687745 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:27:07.687745 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:27:07.687745 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 16:27:07.687745 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 16:27:07.687745 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 16:27:07.687745 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 16:27:07.688679 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:27:07.688679 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:27:07.688679 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 16:27:07.688679 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 16:27:07.688679 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 16:27:07.688679 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 16:27:07.688679 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:27:07.688679 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:27:07.688679 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:27:07.688679 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:27:07.688679 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:27:07.688679 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application with Lock( Aug 09 16:27:07.688679 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:27:07.688679 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:27:07.688679 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:27:07.688679 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:27:07.688679 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:27:07.688679 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:27:07.690115 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:27:07.690115 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:27:07.690115 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 16:27:07.690115 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 16:27:07.690115 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 16:27:07.690115 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 16:27:07.690115 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 16:27:07.690115 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 16:27:07.690115 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 09 16:27:07.690115 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Aug 09 16:27:07.690115 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 255/491] 10.222.0.104 () {56 vars in 1098 bytes} [Tue Aug 9 16:27:07 2022] GET /identity/v3/users/nova => generated 82 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 16:27:07.690115 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104c4d16-7312-4cd7-84a8-b5b0f94afa7a None None] REQUEST_METHOD: `POST` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:07.690868 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104c4d16-7312-4cd7-84a8-b5b0f94afa7a None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:07.690868 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104c4d16-7312-4cd7-84a8-b5b0f94afa7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:07.709205 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.auth.core [None req-104c4d16-7312-4cd7-84a8-b5b0f94afa7a None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:27:07.710422 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.fernet_utils [None req-104c4d16-7312-4cd7-84a8-b5b0f94afa7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:27:07.715270 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dd6fee-8c23-4626-bb9b-af7c7c19b5ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:07.715952 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dd6fee-8c23-4626-bb9b-af7c7c19b5ff None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:07.716327 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dd6fee-8c23-4626-bb9b-af7c7c19b5ff None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:07.716685 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dd6fee-8c23-4626-bb9b-af7c7c19b5ff None admin] PATH_INFO: `/v3/domains` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:07.717439 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dd6fee-8c23-4626-bb9b-af7c7c19b5ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=87276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:27:07.717821 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dd6fee-8c23-4626-bb9b-af7c7c19b5ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:07.719321 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dd6fee-8c23-4626-bb9b-af7c7c19b5ff None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:07.732446 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 237/492] 10.222.0.104 () {56 vars in 1114 bytes} [Tue Aug 9 16:27:07 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:27:07.733431 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dd6fee-8c23-4626-bb9b-af7c7c19b5ff None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:07.779438 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 256/493] 10.222.0.104 () {58 vars in 1029 bytes} [Tue Aug 9 16:27:07 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 16:27:07.780288 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104c4d16-7312-4cd7-84a8-b5b0f94afa7a None None] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:07.815326 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:07.829314 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:07.854847 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dd6fee-8c23-4626-bb9b-af7c7c19b5ff None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:07.880573 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104c4d16-7312-4cd7-84a8-b5b0f94afa7a None None] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:07.889336 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ef61d8-f8c6-439c-853c-c6ebdd43690c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:07.890035 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ef61d8-f8c6-439c-853c-c6ebdd43690c None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:07.890360 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ef61d8-f8c6-439c-853c-c6ebdd43690c None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:07.890634 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ef61d8-f8c6-439c-853c-c6ebdd43690c None admin] PATH_INFO: `/v3/roles` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:07.891455 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ef61d8-f8c6-439c-853c-c6ebdd43690c None admin] RBAC: Adding query filter params (name=service) {{(pid=87276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:27:07.891848 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ef61d8-f8c6-439c-853c-c6ebdd43690c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:07.893322 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ef61d8-f8c6-439c-853c-c6ebdd43690c None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:07.901762 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 238/494] 10.222.0.104 () {56 vars in 1108 bytes} [Tue Aug 9 16:27:07 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:27:07.902744 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ef61d8-f8c6-439c-853c-c6ebdd43690c None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:07.919696 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e9d75c-fadf-4aed-a2cf-c24e89e89bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:07.920410 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e9d75c-fadf-4aed-a2cf-c24e89e89bcc None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:07.920747 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e9d75c-fadf-4aed-a2cf-c24e89e89bcc None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:07.921080 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e9d75c-fadf-4aed-a2cf-c24e89e89bcc None admin] PATH_INFO: `/v3/users` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:07.921957 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e9d75c-fadf-4aed-a2cf-c24e89e89bcc None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:27:07.922304 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e9d75c-fadf-4aed-a2cf-c24e89e89bcc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:07.923721 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e9d75c-fadf-4aed-a2cf-c24e89e89bcc None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:07.964529 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 257/495] 10.222.0.104 () {56 vars in 1138 bytes} [Tue Aug 9 16:27:07 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:27:07.965387 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e9d75c-fadf-4aed-a2cf-c24e89e89bcc None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:08.007849 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ef61d8-f8c6-439c-853c-c6ebdd43690c None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:08.041738 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1bd39b-a22e-4063-839f-98e0076ff5ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:08.042790 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1bd39b-a22e-4063-839f-98e0076ff5ee None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:08.043064 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1bd39b-a22e-4063-839f-98e0076ff5ee None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:08.043331 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1bd39b-a22e-4063-839f-98e0076ff5ee None admin] PATH_INFO: `/v3/users/glance` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:08.046719 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:08.052087 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1bd39b-a22e-4063-839f-98e0076ff5ee None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:08.053723 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1bd39b-a22e-4063-839f-98e0076ff5ee None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:08.060555 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:08.068393 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application [None req-bd1bd39b-a22e-4063-839f-98e0076ff5ee None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 09 16:27:08.068393 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:27:08.068393 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:27:08.068393 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:27:08.068393 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:27:08.068393 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:27:08.068393 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:27:08.068393 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:27:08.068393 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:27:08.068393 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:27:08.068393 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:27:08.068393 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:27:08.068393 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 16:27:08.068393 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 16:27:08.068393 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 16:27:08.068393 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 16:27:08.069401 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:27:08.069401 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:27:08.069401 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 16:27:08.069401 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 16:27:08.069401 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 16:27:08.069401 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 16:27:08.069401 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:27:08.069401 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:27:08.069401 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:27:08.069401 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:27:08.069401 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:27:08.069401 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application with Lock( Aug 09 16:27:08.069401 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:27:08.069401 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:27:08.069401 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:27:08.069401 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:27:08.069401 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:27:08.069401 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:27:08.070321 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:27:08.070321 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:27:08.070321 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 16:27:08.070321 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 16:27:08.070321 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 16:27:08.070321 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 16:27:08.070321 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 16:27:08.070321 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 16:27:08.070321 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 09 16:27:08.070321 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Aug 09 16:27:08.070321 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 239/496] 10.222.0.104 () {56 vars in 1104 bytes} [Tue Aug 9 16:27:07 2022] GET /identity/v3/users/glance => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 16:27:08.070941 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1bd39b-a22e-4063-839f-98e0076ff5ee None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:08.076736 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e9d75c-fadf-4aed-a2cf-c24e89e89bcc None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:08.112902 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31743aba-0b3c-4307-bf0a-4d3e36a26836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:08.113459 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31743aba-0b3c-4307-bf0a-4d3e36a26836 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:08.113737 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31743aba-0b3c-4307-bf0a-4d3e36a26836 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:08.114410 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31743aba-0b3c-4307-bf0a-4d3e36a26836 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:08.124772 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31743aba-0b3c-4307-bf0a-4d3e36a26836 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 16:27:08.129444 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application [None req-31743aba-0b3c-4307-bf0a-4d3e36a26836 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 16:27:08.129444 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:27:08.129444 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:27:08.129444 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:27:08.129444 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:27:08.129444 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:27:08.129444 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:27:08.129444 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:27:08.129444 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:27:08.129444 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:27:08.129444 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:27:08.129444 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:27:08.129444 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 16:27:08.129444 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 16:27:08.129444 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 16:27:08.129444 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 16:27:08.130523 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 16:27:08.130523 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 16:27:08.130523 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 16:27:08.130523 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 16:27:08.130523 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:27:08.130523 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:27:08.130523 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:27:08.130523 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:27:08.130523 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:27:08.130523 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:27:08.130523 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:27:08.130523 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application with Lock( Aug 09 16:27:08.130523 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:27:08.130523 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:27:08.130523 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:27:08.130523 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:27:08.131420 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:27:08.131420 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:27:08.131420 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:27:08.131420 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:27:08.131420 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 16:27:08.131420 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 16:27:08.131420 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 16:27:08.131420 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 16:27:08.131420 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 16:27:08.131420 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 16:27:08.131420 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 16:27:08.131420 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Aug 09 16:27:08.131420 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 258/497] 10.222.0.104 () {56 vars in 1107 bytes} [Tue Aug 9 16:27:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 16:27:08.132075 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31743aba-0b3c-4307-bf0a-4d3e36a26836 None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:08.175031 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1bd39b-a22e-4063-839f-98e0076ff5ee None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:08.210373 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb9fa79-7809-4eaf-8f39-eb97c9e15ab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:08.210996 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb9fa79-7809-4eaf-8f39-eb97c9e15ab0 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:08.211271 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb9fa79-7809-4eaf-8f39-eb97c9e15ab0 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:08.211548 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb9fa79-7809-4eaf-8f39-eb97c9e15ab0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:08.222044 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb9fa79-7809-4eaf-8f39-eb97c9e15ab0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:08.223507 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb9fa79-7809-4eaf-8f39-eb97c9e15ab0 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:08.233965 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31743aba-0b3c-4307-bf0a-4d3e36a26836 None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:08.237607 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application [None req-3bb9fa79-7809-4eaf-8f39-eb97c9e15ab0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 16:27:08.237607 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:27:08.237607 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:27:08.237607 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:27:08.237607 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:27:08.237607 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:27:08.237607 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:27:08.237607 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:27:08.237607 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:27:08.237607 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:27:08.237607 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:27:08.237607 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:27:08.237607 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 16:27:08.237607 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 16:27:08.237607 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 16:27:08.237607 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 16:27:08.238799 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:27:08.238799 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:27:08.238799 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:27:08.238799 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:27:08.238799 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:27:08.238799 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:27:08.238799 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:27:08.238799 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application with Lock( Aug 09 16:27:08.238799 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:27:08.238799 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:27:08.238799 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:27:08.238799 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:27:08.238799 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:27:08.238799 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:27:08.238799 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:27:08.238799 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:27:08.238799 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 16:27:08.239666 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 16:27:08.239666 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 16:27:08.239666 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Aug 09 16:27:08.239666 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 240/498] 10.222.0.104 () {56 vars in 1113 bytes} [Tue Aug 9 16:27:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 16:27:08.239666 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb9fa79-7809-4eaf-8f39-eb97c9e15ab0 None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:08.271472 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e0a2e1-b0cd-4e11-aafe-27b1989c0da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:08.272066 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e0a2e1-b0cd-4e11-aafe-27b1989c0da1 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:08.272342 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e0a2e1-b0cd-4e11-aafe-27b1989c0da1 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:08.272607 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e0a2e1-b0cd-4e11-aafe-27b1989c0da1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:08.290827 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:08.300239 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:08.342503 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb9fa79-7809-4eaf-8f39-eb97c9e15ab0 None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:08.346651 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e0a2e1-b0cd-4e11-aafe-27b1989c0da1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:08.348106 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e0a2e1-b0cd-4e11-aafe-27b1989c0da1 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:08.377592 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f678ccd1-5073-477a-baa9-df6f4464ba0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:08.378146 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f678ccd1-5073-477a-baa9-df6f4464ba0b None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:08.378425 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f678ccd1-5073-477a-baa9-df6f4464ba0b None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:08.378695 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f678ccd1-5073-477a-baa9-df6f4464ba0b None admin] PATH_INFO: `/v3/users` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:08.379441 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f678ccd1-5073-477a-baa9-df6f4464ba0b None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=87276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:27:08.379730 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f678ccd1-5073-477a-baa9-df6f4464ba0b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:08.381147 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f678ccd1-5073-477a-baa9-df6f4464ba0b None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:08.423600 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 241/499] 10.222.0.104 () {56 vars in 1142 bytes} [Tue Aug 9 16:27:08 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 374 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:27:08.423600 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f678ccd1-5073-477a-baa9-df6f4464ba0b None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:08.454322 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 259/500] 10.222.0.104 () {58 vars in 1287 bytes} [Tue Aug 9 16:27:08 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 16:27:08.455336 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e0a2e1-b0cd-4e11-aafe-27b1989c0da1 None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:08.509375 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:08.517449 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f678ccd1-5073-477a-baa9-df6f4464ba0b None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:08.524630 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:08.551755 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da99d5a6-9574-40f1-a464-6c607c295259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:08.552414 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da99d5a6-9574-40f1-a464-6c607c295259 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:08.552714 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da99d5a6-9574-40f1-a464-6c607c295259 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:08.552978 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da99d5a6-9574-40f1-a464-6c607c295259 None admin] PATH_INFO: `/v3/roles` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:08.553629 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da99d5a6-9574-40f1-a464-6c607c295259 None admin] RBAC: Adding query filter params (name=service) {{(pid=87276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:27:08.553953 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da99d5a6-9574-40f1-a464-6c607c295259 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:08.555358 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da99d5a6-9574-40f1-a464-6c607c295259 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:08.555583 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e0a2e1-b0cd-4e11-aafe-27b1989c0da1 None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:08.563768 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 242/501] 10.222.0.104 () {56 vars in 1108 bytes} [Tue Aug 9 16:27:08 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:27:08.564370 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da99d5a6-9574-40f1-a464-6c607c295259 None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:08.588984 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe619b1-6905-4cd1-9fe4-e697b9b025de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:08.589579 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe619b1-6905-4cd1-9fe4-e697b9b025de None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:08.589849 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe619b1-6905-4cd1-9fe4-e697b9b025de None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:08.590702 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe619b1-6905-4cd1-9fe4-e697b9b025de None admin] PATH_INFO: `/v3/domains` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:08.591399 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe619b1-6905-4cd1-9fe4-e697b9b025de None admin] RBAC: Adding query filter params (name=Default) {{(pid=87275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:27:08.591696 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe619b1-6905-4cd1-9fe4-e697b9b025de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:08.593057 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe619b1-6905-4cd1-9fe4-e697b9b025de None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:08.603720 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 260/502] 10.222.0.104 () {56 vars in 1114 bytes} [Tue Aug 9 16:27:08 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:27:08.604497 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe619b1-6905-4cd1-9fe4-e697b9b025de None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:08.664200 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da99d5a6-9574-40f1-a464-6c607c295259 None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:08.700306 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370d8d56-13c4-4a4e-b265-1bbbfe0dd407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:08.700930 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370d8d56-13c4-4a4e-b265-1bbbfe0dd407 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:08.701185 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370d8d56-13c4-4a4e-b265-1bbbfe0dd407 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:08.701452 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370d8d56-13c4-4a4e-b265-1bbbfe0dd407 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:08.707166 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe619b1-6905-4cd1-9fe4-e697b9b025de None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:08.721172 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:08.736281 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:08.742397 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68535337-ce42-407e-bfbb-a9bddbf49fbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:08.743016 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68535337-ce42-407e-bfbb-a9bddbf49fbf None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:08.743293 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68535337-ce42-407e-bfbb-a9bddbf49fbf None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:08.743566 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68535337-ce42-407e-bfbb-a9bddbf49fbf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:08.754643 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68535337-ce42-407e-bfbb-a9bddbf49fbf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:08.756044 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68535337-ce42-407e-bfbb-a9bddbf49fbf None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:08.770922 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application [None req-68535337-ce42-407e-bfbb-a9bddbf49fbf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 16:27:08.770922 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:27:08.770922 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:27:08.770922 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:27:08.770922 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:27:08.770922 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:27:08.770922 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:27:08.770922 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:27:08.770922 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:27:08.770922 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:27:08.770922 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:27:08.770922 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:27:08.770922 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 16:27:08.770922 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 16:27:08.770922 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 16:27:08.770922 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 16:27:08.771927 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:27:08.771927 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:27:08.771927 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:27:08.771927 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:27:08.771927 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:27:08.771927 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:27:08.771927 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:27:08.771927 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application with Lock( Aug 09 16:27:08.771927 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:27:08.771927 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:27:08.771927 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:27:08.771927 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:27:08.771927 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:27:08.771927 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:27:08.771927 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:27:08.771927 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:27:08.771927 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 16:27:08.772785 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 16:27:08.772785 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 16:27:08.772785 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Aug 09 16:27:08.772785 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 261/503] 10.222.0.104 () {56 vars in 1113 bytes} [Tue Aug 9 16:27:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 16:27:08.772785 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68535337-ce42-407e-bfbb-a9bddbf49fbf None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:08.776610 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370d8d56-13c4-4a4e-b265-1bbbfe0dd407 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:08.778548 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370d8d56-13c4-4a4e-b265-1bbbfe0dd407 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:08.874864 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 243/504] 10.222.0.104 () {58 vars in 1287 bytes} [Tue Aug 9 16:27:08 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 16:27:08.875614 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370d8d56-13c4-4a4e-b265-1bbbfe0dd407 None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:08.879950 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68535337-ce42-407e-bfbb-a9bddbf49fbf None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:08.913568 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e434e3c-d49d-4ec0-8f13-a9678b9bdedd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:08.914276 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e434e3c-d49d-4ec0-8f13-a9678b9bdedd None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:08.914492 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e434e3c-d49d-4ec0-8f13-a9678b9bdedd None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:08.914761 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e434e3c-d49d-4ec0-8f13-a9678b9bdedd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:08.925576 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e434e3c-d49d-4ec0-8f13-a9678b9bdedd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:08.927076 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e434e3c-d49d-4ec0-8f13-a9678b9bdedd None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:08.940830 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application [None req-1e434e3c-d49d-4ec0-8f13-a9678b9bdedd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 16:27:08.940830 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:27:08.940830 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:27:08.940830 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:27:08.940830 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:27:08.940830 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:27:08.940830 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:27:08.940830 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:27:08.940830 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:27:08.940830 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:27:08.940830 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:27:08.940830 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:27:08.940830 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 16:27:08.940830 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 16:27:08.940830 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 16:27:08.940830 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 16:27:08.941757 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:27:08.941757 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:27:08.941757 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:27:08.941757 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:27:08.941757 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:27:08.941757 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:27:08.941757 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:27:08.941757 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application with Lock( Aug 09 16:27:08.941757 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:27:08.941757 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:27:08.941757 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:27:08.941757 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:27:08.941757 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:27:08.941757 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:27:08.941757 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:27:08.941757 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:27:08.941757 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 16:27:08.942898 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 16:27:08.942898 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 16:27:08.942898 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Aug 09 16:27:08.943217 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:08.943288 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 262/505] 10.222.0.104 () {56 vars in 1113 bytes} [Tue Aug 9 16:27:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 16:27:08.943288 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e434e3c-d49d-4ec0-8f13-a9678b9bdedd None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:08.961422 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:08.979991 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370d8d56-13c4-4a4e-b265-1bbbfe0dd407 None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:09.013463 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6340bd-3266-4e10-97b5-88a00b21dc15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:09.014117 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6340bd-3266-4e10-97b5-88a00b21dc15 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:09.014395 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6340bd-3266-4e10-97b5-88a00b21dc15 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:09.014688 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6340bd-3266-4e10-97b5-88a00b21dc15 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:09.021494 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6340bd-3266-4e10-97b5-88a00b21dc15 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:09.022955 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6340bd-3266-4e10-97b5-88a00b21dc15 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:09.034753 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application [None req-8c6340bd-3266-4e10-97b5-88a00b21dc15 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 09 16:27:09.034753 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:27:09.034753 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:27:09.034753 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:27:09.034753 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:27:09.034753 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:27:09.034753 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:27:09.034753 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:27:09.034753 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:27:09.034753 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:27:09.034753 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:27:09.034753 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:27:09.034753 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 16:27:09.034753 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 16:27:09.034753 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 16:27:09.034753 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 16:27:09.035820 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:27:09.035820 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:27:09.035820 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 16:27:09.035820 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 16:27:09.035820 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 16:27:09.035820 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 16:27:09.035820 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:27:09.035820 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:27:09.035820 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:27:09.035820 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:27:09.035820 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:27:09.035820 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application with Lock( Aug 09 16:27:09.035820 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:27:09.035820 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:27:09.035820 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:27:09.035820 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:27:09.035820 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:27:09.035820 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:27:09.036732 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:27:09.036732 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:27:09.036732 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 16:27:09.036732 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 16:27:09.036732 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 16:27:09.036732 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 16:27:09.036732 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 16:27:09.036732 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 16:27:09.036732 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 09 16:27:09.036732 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Aug 09 16:27:09.036732 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 244/506] 10.222.0.104 () {56 vars in 1104 bytes} [Tue Aug 9 16:27:08 2022] GET /identity/v3/users/cinder => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 16:27:09.037278 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6340bd-3266-4e10-97b5-88a00b21dc15 None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:09.047904 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e434e3c-d49d-4ec0-8f13-a9678b9bdedd None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:09.081155 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445b98d9-d59f-4179-85f9-f850a98e4105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:09.081758 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445b98d9-d59f-4179-85f9-f850a98e4105 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:09.082076 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445b98d9-d59f-4179-85f9-f850a98e4105 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:09.082352 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445b98d9-d59f-4179-85f9-f850a98e4105 None admin] PATH_INFO: `/v3/domains` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:09.082978 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445b98d9-d59f-4179-85f9-f850a98e4105 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:27:09.083277 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445b98d9-d59f-4179-85f9-f850a98e4105 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:09.084642 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445b98d9-d59f-4179-85f9-f850a98e4105 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:09.096684 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 263/507] 10.222.0.104 () {56 vars in 1114 bytes} [Tue Aug 9 16:27:08 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:27:09.097289 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445b98d9-d59f-4179-85f9-f850a98e4105 None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:09.140146 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6340bd-3266-4e10-97b5-88a00b21dc15 None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:09.165674 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:09.174201 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e889de-273f-4851-828e-46e863d36399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:09.174614 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:09.174822 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e889de-273f-4851-828e-46e863d36399 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:09.175343 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e889de-273f-4851-828e-46e863d36399 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:09.175343 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e889de-273f-4851-828e-46e863d36399 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:09.186122 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e889de-273f-4851-828e-46e863d36399 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:09.187581 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e889de-273f-4851-828e-46e863d36399 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:09.196073 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445b98d9-d59f-4179-85f9-f850a98e4105 None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:09.203303 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application [None req-88e889de-273f-4851-828e-46e863d36399 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 16:27:09.203303 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:27:09.203303 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:27:09.203303 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:27:09.203303 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:27:09.203303 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:27:09.203303 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:27:09.203303 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:27:09.203303 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:27:09.203303 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:27:09.203303 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:27:09.203303 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:27:09.203303 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 16:27:09.203303 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 16:27:09.203303 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 16:27:09.203303 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 16:27:09.204304 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:27:09.204304 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:27:09.204304 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:27:09.204304 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:27:09.204304 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:27:09.204304 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:27:09.204304 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:27:09.204304 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application with Lock( Aug 09 16:27:09.204304 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:27:09.204304 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:27:09.204304 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:27:09.204304 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:27:09.204304 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:27:09.204304 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:27:09.204304 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:27:09.204304 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:27:09.204304 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 16:27:09.205352 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 16:27:09.205352 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 16:27:09.205352 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Aug 09 16:27:09.206212 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 245/508] 10.222.0.104 () {56 vars in 1113 bytes} [Tue Aug 9 16:27:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 16:27:09.207048 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e889de-273f-4851-828e-46e863d36399 None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:09.230813 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1909ba4-c26e-4d16-801f-65db9c6fd3e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:09.231413 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1909ba4-c26e-4d16-801f-65db9c6fd3e1 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:09.231683 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1909ba4-c26e-4d16-801f-65db9c6fd3e1 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:09.231949 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1909ba4-c26e-4d16-801f-65db9c6fd3e1 None admin] PATH_INFO: `/v3/domains` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:09.232578 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1909ba4-c26e-4d16-801f-65db9c6fd3e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:27:09.232873 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1909ba4-c26e-4d16-801f-65db9c6fd3e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:09.234262 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1909ba4-c26e-4d16-801f-65db9c6fd3e1 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:09.245123 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 264/509] 10.222.0.104 () {56 vars in 1114 bytes} [Tue Aug 9 16:27:09 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:27:09.245940 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1909ba4-c26e-4d16-801f-65db9c6fd3e1 None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:09.310410 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e889de-273f-4851-828e-46e863d36399 None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:09.345070 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1909ba4-c26e-4d16-801f-65db9c6fd3e1 None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:09.346914 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd91ac1-d082-4a94-89d8-ca9da2edf521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:09.347535 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd91ac1-d082-4a94-89d8-ca9da2edf521 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:09.347853 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd91ac1-d082-4a94-89d8-ca9da2edf521 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:09.348155 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd91ac1-d082-4a94-89d8-ca9da2edf521 None admin] PATH_INFO: `/v3/users` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:09.348940 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd91ac1-d082-4a94-89d8-ca9da2edf521 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=87276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:27:09.349253 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd91ac1-d082-4a94-89d8-ca9da2edf521 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:09.350841 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd91ac1-d082-4a94-89d8-ca9da2edf521 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:09.367936 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 246/510] 10.222.0.104 () {56 vars in 1142 bytes} [Tue Aug 9 16:27:09 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 374 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:27:09.368818 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd91ac1-d082-4a94-89d8-ca9da2edf521 None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:09.378088 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21640f1-ae01-456b-940b-79cd4f89e401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:09.378711 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21640f1-ae01-456b-940b-79cd4f89e401 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:09.378987 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21640f1-ae01-456b-940b-79cd4f89e401 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:09.379255 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21640f1-ae01-456b-940b-79cd4f89e401 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:09.385788 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21640f1-ae01-456b-940b-79cd4f89e401 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:09.387808 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21640f1-ae01-456b-940b-79cd4f89e401 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:09.389495 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:09.400470 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application [None req-d21640f1-ae01-456b-940b-79cd4f89e401 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 16:27:09.400470 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:27:09.400470 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:27:09.400470 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:27:09.400470 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:27:09.400470 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:27:09.400470 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:27:09.400470 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:27:09.400470 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:27:09.400470 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:27:09.400470 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:27:09.400470 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:27:09.400470 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 16:27:09.400470 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 16:27:09.400470 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 16:27:09.401354 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 16:27:09.401354 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:27:09.401354 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:27:09.401354 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:27:09.401354 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:27:09.401354 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:27:09.401354 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:27:09.401354 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:27:09.401354 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application with Lock( Aug 09 16:27:09.401354 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:27:09.401354 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:27:09.401354 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:27:09.401354 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:27:09.401354 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:27:09.401354 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:27:09.401354 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:27:09.401354 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:27:09.403519 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 16:27:09.403519 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 16:27:09.403519 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 16:27:09.403519 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 16:27:09.403519 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 16:27:09.403519 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 16:27:09.403519 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 16:27:09.403519 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Aug 09 16:27:09.403519 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 265/511] 10.222.0.104 () {56 vars in 1116 bytes} [Tue Aug 9 16:27:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 16:27:09.403519 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21640f1-ae01-456b-940b-79cd4f89e401 None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:09.414248 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:09.477032 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd91ac1-d082-4a94-89d8-ca9da2edf521 None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:09.503030 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21640f1-ae01-456b-940b-79cd4f89e401 None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:09.509793 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07b0b0b-cb9a-47ee-bade-70058ecd0a80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:09.510433 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07b0b0b-cb9a-47ee-bade-70058ecd0a80 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:09.510700 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07b0b0b-cb9a-47ee-bade-70058ecd0a80 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:09.510968 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07b0b0b-cb9a-47ee-bade-70058ecd0a80 None admin] PATH_INFO: `/v3/domains` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:09.511594 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07b0b0b-cb9a-47ee-bade-70058ecd0a80 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:27:09.512414 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07b0b0b-cb9a-47ee-bade-70058ecd0a80 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:09.513787 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07b0b0b-cb9a-47ee-bade-70058ecd0a80 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:09.524774 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 247/512] 10.222.0.104 () {56 vars in 1114 bytes} [Tue Aug 9 16:27:09 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:27:09.525572 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07b0b0b-cb9a-47ee-bade-70058ecd0a80 None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:09.536412 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc4bb33-c219-432d-9da5-be5881e6ce3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:09.537033 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc4bb33-c219-432d-9da5-be5881e6ce3c None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:09.537307 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc4bb33-c219-432d-9da5-be5881e6ce3c None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:09.537574 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc4bb33-c219-432d-9da5-be5881e6ce3c None admin] PATH_INFO: `/v3/users/neutron` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:09.544960 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc4bb33-c219-432d-9da5-be5881e6ce3c None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:09.546430 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc4bb33-c219-432d-9da5-be5881e6ce3c None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:09.557312 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application [None req-bcc4bb33-c219-432d-9da5-be5881e6ce3c None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 09 16:27:09.557312 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:27:09.557312 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:27:09.557312 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:27:09.557312 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:27:09.557312 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:27:09.557312 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:27:09.557312 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:27:09.557312 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:27:09.557312 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:27:09.557312 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:27:09.557312 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:27:09.557312 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 16:27:09.557312 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 16:27:09.557312 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 16:27:09.557312 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 16:27:09.558268 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:27:09.558268 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:27:09.558268 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 16:27:09.558268 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 16:27:09.558268 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 16:27:09.558268 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 16:27:09.558268 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:27:09.558268 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:27:09.558268 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:27:09.558268 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:27:09.558268 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:27:09.558268 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application with Lock( Aug 09 16:27:09.558268 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:27:09.558268 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:27:09.558268 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:27:09.558268 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:27:09.558268 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:27:09.558268 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:27:09.559701 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:27:09.559701 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:27:09.559701 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 16:27:09.559701 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 16:27:09.559701 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 16:27:09.559701 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 16:27:09.559701 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 16:27:09.559701 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 16:27:09.559701 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 09 16:27:09.559701 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Aug 09 16:27:09.559701 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 266/513] 10.222.0.104 () {56 vars in 1107 bytes} [Tue Aug 9 16:27:09 2022] GET /identity/v3/users/neutron => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 16:27:09.559701 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc4bb33-c219-432d-9da5-be5881e6ce3c None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:09.614681 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:09.625560 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:09.629831 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07b0b0b-cb9a-47ee-bade-70058ecd0a80 None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:09.656501 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc4bb33-c219-432d-9da5-be5881e6ce3c None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:09.664065 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1beced2-7167-470e-bea3-990c3b997d33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:09.664665 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1beced2-7167-470e-bea3-990c3b997d33 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:09.664951 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1beced2-7167-470e-bea3-990c3b997d33 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:09.665220 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1beced2-7167-470e-bea3-990c3b997d33 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:09.689070 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d111ecce-3848-4376-8929-b3b9c8c0f4d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:09.689667 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d111ecce-3848-4376-8929-b3b9c8c0f4d4 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:09.689973 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d111ecce-3848-4376-8929-b3b9c8c0f4d4 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:09.690242 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d111ecce-3848-4376-8929-b3b9c8c0f4d4 None admin] PATH_INFO: `/v3/projects` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:09.690921 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d111ecce-3848-4376-8929-b3b9c8c0f4d4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:27:09.691220 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d111ecce-3848-4376-8929-b3b9c8c0f4d4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:09.692679 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d111ecce-3848-4376-8929-b3b9c8c0f4d4 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:09.712091 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 267/514] 10.222.0.104 () {56 vars in 1153 bytes} [Tue Aug 9 16:27:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:27:09.712783 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d111ecce-3848-4376-8929-b3b9c8c0f4d4 None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:09.745563 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1beced2-7167-470e-bea3-990c3b997d33 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:09.747471 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1beced2-7167-470e-bea3-990c3b997d33 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:09.818702 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d111ecce-3848-4376-8929-b3b9c8c0f4d4 None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:09.836198 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:09.845835 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:09.851329 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 248/515] 10.222.0.104 () {58 vars in 1287 bytes} [Tue Aug 9 16:27:09 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 16:27:09.852337 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1beced2-7167-470e-bea3-990c3b997d33 None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:09.854508 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bf4d1c-800c-4321-8306-ee27805e54a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:09.855135 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bf4d1c-800c-4321-8306-ee27805e54a4 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:09.855416 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bf4d1c-800c-4321-8306-ee27805e54a4 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:09.856348 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bf4d1c-800c-4321-8306-ee27805e54a4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:09.862412 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bf4d1c-800c-4321-8306-ee27805e54a4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:09.863870 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bf4d1c-800c-4321-8306-ee27805e54a4 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:09.879219 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application [None req-90bf4d1c-800c-4321-8306-ee27805e54a4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 16:27:09.879219 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:27:09.879219 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:27:09.879219 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:27:09.879219 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:27:09.879219 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:27:09.879219 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:27:09.879219 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:27:09.879219 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:27:09.879219 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:27:09.879219 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:27:09.879219 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:27:09.879219 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 16:27:09.879219 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 16:27:09.879219 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 16:27:09.880083 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 16:27:09.880083 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:27:09.880083 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:27:09.880083 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:27:09.880083 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:27:09.880083 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:27:09.880083 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:27:09.880083 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:27:09.880083 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application with Lock( Aug 09 16:27:09.880083 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:27:09.880083 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:27:09.880083 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:27:09.880083 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:27:09.880083 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:27:09.880083 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:27:09.880083 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:27:09.880083 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:27:09.880905 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 16:27:09.880905 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 16:27:09.880905 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 16:27:09.880905 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 16:27:09.880905 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 16:27:09.880905 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 16:27:09.880905 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 16:27:09.880905 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Aug 09 16:27:09.880905 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 268/516] 10.222.0.104 () {56 vars in 1116 bytes} [Tue Aug 9 16:27:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 16:27:09.881357 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bf4d1c-800c-4321-8306-ee27805e54a4 None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:09.956016 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1beced2-7167-470e-bea3-990c3b997d33 None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:09.981882 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bf4d1c-800c-4321-8306-ee27805e54a4 None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:09.989992 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143c80fb-b252-4344-8f4f-1d681ec0180e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:09.990594 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143c80fb-b252-4344-8f4f-1d681ec0180e None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:09.990876 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143c80fb-b252-4344-8f4f-1d681ec0180e None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:09.991140 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143c80fb-b252-4344-8f4f-1d681ec0180e None admin] PATH_INFO: `/v3/users` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:09.991848 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143c80fb-b252-4344-8f4f-1d681ec0180e None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=87276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:27:09.992153 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143c80fb-b252-4344-8f4f-1d681ec0180e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:09.993578 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143c80fb-b252-4344-8f4f-1d681ec0180e None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:10.012698 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 249/517] 10.222.0.104 () {56 vars in 1144 bytes} [Tue Aug 9 16:27:09 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 376 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:27:10.013497 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143c80fb-b252-4344-8f4f-1d681ec0180e None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:10.023859 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de0e416-9a88-42f9-be28-e00e7d976164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:10.024470 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de0e416-9a88-42f9-be28-e00e7d976164 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:10.024748 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de0e416-9a88-42f9-be28-e00e7d976164 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:10.025018 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de0e416-9a88-42f9-be28-e00e7d976164 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:10.025776 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de0e416-9a88-42f9-be28-e00e7d976164 None admin] RBAC: Adding query filter params (role.id=aa624ab843384e48873a8d5a72422836, scope.project.id=63557f0ff1ce4ae49899b4627bafd94e, user.id=b4c33c3fc318484d9cdfae778d23f06a) {{(pid=87275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:27:10.026108 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de0e416-9a88-42f9-be28-e00e7d976164 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:10.027595 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de0e416-9a88-42f9-be28-e00e7d976164 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:10.033122 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 269/518] 10.222.0.104 () {56 vars in 1379 bytes} [Tue Aug 9 16:27:09 2022] GET /identity/v3/role_assignments?user.id=b4c33c3fc318484d9cdfae778d23f06a&scope.project.id=63557f0ff1ce4ae49899b4627bafd94e&role.id=aa624ab843384e48873a8d5a72422836 => generated 260 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:27:10.033941 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de0e416-9a88-42f9-be28-e00e7d976164 None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:10.082356 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:10.087230 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:10.134731 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143c80fb-b252-4344-8f4f-1d681ec0180e None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:10.154329 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de0e416-9a88-42f9-be28-e00e7d976164 None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:10.176424 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6019b605-8be5-4c99-b922-dcbeeb984413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:10.177808 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6019b605-8be5-4c99-b922-dcbeeb984413 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:10.178480 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6019b605-8be5-4c99-b922-dcbeeb984413 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:10.179060 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6019b605-8be5-4c99-b922-dcbeeb984413 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:10.191689 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd55650-38b3-490b-9144-b9f40501016b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:10.192305 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd55650-38b3-490b-9144-b9f40501016b None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:10.192578 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd55650-38b3-490b-9144-b9f40501016b None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:10.192847 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd55650-38b3-490b-9144-b9f40501016b None admin] PATH_INFO: `/v3/projects` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:10.193137 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6019b605-8be5-4c99-b922-dcbeeb984413 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:10.193545 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd55650-38b3-490b-9144-b9f40501016b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:27:10.193851 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd55650-38b3-490b-9144-b9f40501016b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:10.195243 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6019b605-8be5-4c99-b922-dcbeeb984413 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:10.195377 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd55650-38b3-490b-9144-b9f40501016b None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:10.208977 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 270/519] 10.222.0.104 () {56 vars in 1153 bytes} [Tue Aug 9 16:27:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:27:10.209935 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd55650-38b3-490b-9144-b9f40501016b None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:10.212190 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application [None req-6019b605-8be5-4c99-b922-dcbeeb984413 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 16:27:10.212190 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:27:10.212190 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:27:10.212190 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:27:10.212190 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:27:10.212190 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:27:10.212190 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:27:10.212190 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:27:10.212190 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:27:10.212190 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:27:10.212190 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:27:10.212190 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:27:10.212190 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 16:27:10.212190 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 16:27:10.212190 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 16:27:10.212190 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 16:27:10.213108 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:27:10.213108 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:27:10.213108 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:27:10.213108 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:27:10.213108 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:27:10.213108 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:27:10.213108 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:27:10.213108 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application with Lock( Aug 09 16:27:10.213108 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:27:10.213108 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:27:10.213108 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:27:10.213108 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:27:10.213108 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:27:10.213108 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:27:10.213108 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:27:10.213108 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:27:10.213108 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 16:27:10.214018 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 16:27:10.214018 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 16:27:10.214018 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Aug 09 16:27:10.214018 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 250/520] 10.222.0.104 () {56 vars in 1113 bytes} [Tue Aug 9 16:27:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 16:27:10.216878 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6019b605-8be5-4c99-b922-dcbeeb984413 None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:10.326141 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6019b605-8be5-4c99-b922-dcbeeb984413 None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:10.329676 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd55650-38b3-490b-9144-b9f40501016b None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:10.331249 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:10.335283 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:10.362427 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be09d97-d1c6-4bee-a0f7-badd69b59f43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:10.363271 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be09d97-d1c6-4bee-a0f7-badd69b59f43 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:10.363551 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be09d97-d1c6-4bee-a0f7-badd69b59f43 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:10.363824 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be09d97-d1c6-4bee-a0f7-badd69b59f43 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:10.364553 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be09d97-d1c6-4bee-a0f7-badd69b59f43 None admin] RBAC: Adding query filter params (role.id=aa624ab843384e48873a8d5a72422836, scope.project.id=63557f0ff1ce4ae49899b4627bafd94e, user.id=717261252a9a44de8a71c10fda7082b0) {{(pid=87276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:27:10.364863 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be09d97-d1c6-4bee-a0f7-badd69b59f43 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:10.366307 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be09d97-d1c6-4bee-a0f7-badd69b59f43 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:10.369740 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d4da49-3b82-4273-9621-cdc1d28be878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:10.370427 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d4da49-3b82-4273-9621-cdc1d28be878 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:10.370675 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d4da49-3b82-4273-9621-cdc1d28be878 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:10.370919 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d4da49-3b82-4273-9621-cdc1d28be878 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:10.372857 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 251/521] 10.222.0.104 () {56 vars in 1379 bytes} [Tue Aug 9 16:27:10 2022] GET /identity/v3/role_assignments?user.id=717261252a9a44de8a71c10fda7082b0&scope.project.id=63557f0ff1ce4ae49899b4627bafd94e&role.id=aa624ab843384e48873a8d5a72422836 => generated 260 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 16:27:10.378975 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be09d97-d1c6-4bee-a0f7-badd69b59f43 None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:10.468351 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d4da49-3b82-4273-9621-cdc1d28be878 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:10.470042 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d4da49-3b82-4273-9621-cdc1d28be878 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:10.528353 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be09d97-d1c6-4bee-a0f7-badd69b59f43 None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:10.568870 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67160027-ab66-49f1-a2b4-b907ca9a98aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:10.569922 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67160027-ab66-49f1-a2b4-b907ca9a98aa None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:10.570351 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67160027-ab66-49f1-a2b4-b907ca9a98aa None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:10.570772 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67160027-ab66-49f1-a2b4-b907ca9a98aa None admin] PATH_INFO: `/v3/domains` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:10.571553 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67160027-ab66-49f1-a2b4-b907ca9a98aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=87276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:27:10.571999 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67160027-ab66-49f1-a2b4-b907ca9a98aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:10.573523 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67160027-ab66-49f1-a2b4-b907ca9a98aa None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:10.591670 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 252/522] 10.222.0.104 () {56 vars in 1114 bytes} [Tue Aug 9 16:27:10 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:27:10.592505 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67160027-ab66-49f1-a2b4-b907ca9a98aa None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:10.599163 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 271/523] 10.222.0.104 () {58 vars in 1287 bytes} [Tue Aug 9 16:27:10 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 16:27:10.600179 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d4da49-3b82-4273-9621-cdc1d28be878 None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:10.602165 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:10.633805 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:10.717350 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67160027-ab66-49f1-a2b4-b907ca9a98aa None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:10.745580 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d4da49-3b82-4273-9621-cdc1d28be878 None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:10.754186 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e58207-bac9-4153-87b2-0b3fced34f98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:10.754817 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e58207-bac9-4153-87b2-0b3fced34f98 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:10.755096 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e58207-bac9-4153-87b2-0b3fced34f98 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:10.755372 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e58207-bac9-4153-87b2-0b3fced34f98 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:10.762979 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e58207-bac9-4153-87b2-0b3fced34f98 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:10.764431 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e58207-bac9-4153-87b2-0b3fced34f98 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:10.777322 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application [None req-00e58207-bac9-4153-87b2-0b3fced34f98 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 16:27:10.777322 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:27:10.777322 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:27:10.777322 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:27:10.777322 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:27:10.777322 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:27:10.777322 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:27:10.777322 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:27:10.777322 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:27:10.777322 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:27:10.777322 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:27:10.777322 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:27:10.777322 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 16:27:10.777322 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 16:27:10.777322 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 16:27:10.778225 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 16:27:10.778225 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:27:10.778225 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:27:10.778225 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:27:10.778225 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:27:10.778225 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:27:10.778225 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:27:10.778225 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:27:10.778225 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application with Lock( Aug 09 16:27:10.778225 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:27:10.778225 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:27:10.778225 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:27:10.778225 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:27:10.778225 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:27:10.778225 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:27:10.778225 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:27:10.778225 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:27:10.779177 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 16:27:10.779177 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 16:27:10.779177 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 16:27:10.779177 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 16:27:10.779177 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 16:27:10.779177 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 16:27:10.779177 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 16:27:10.779177 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Aug 09 16:27:10.783371 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 253/524] 10.222.0.104 () {56 vars in 1116 bytes} [Tue Aug 9 16:27:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 16:27:10.784329 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e58207-bac9-4153-87b2-0b3fced34f98 None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:10.792676 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3f3357-0fa4-4414-8504-49dc2c66ddfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:10.794316 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3f3357-0fa4-4414-8504-49dc2c66ddfe None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:10.794817 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3f3357-0fa4-4414-8504-49dc2c66ddfe None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:10.795276 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3f3357-0fa4-4414-8504-49dc2c66ddfe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:10.806994 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3f3357-0fa4-4414-8504-49dc2c66ddfe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:10.809441 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3f3357-0fa4-4414-8504-49dc2c66ddfe None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:10.825540 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application [None req-1a3f3357-0fa4-4414-8504-49dc2c66ddfe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 16:27:10.825540 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:27:10.825540 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:27:10.825540 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:27:10.825540 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:27:10.825540 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:27:10.825540 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:27:10.825540 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:27:10.825540 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:27:10.825540 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:27:10.825540 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:27:10.825540 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:27:10.825540 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 16:27:10.825540 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 16:27:10.825540 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 16:27:10.825540 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 16:27:10.826658 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:27:10.826658 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:27:10.826658 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:27:10.826658 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:27:10.826658 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:27:10.826658 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:27:10.826658 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:27:10.826658 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application with Lock( Aug 09 16:27:10.826658 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:27:10.826658 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:27:10.826658 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:27:10.826658 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:27:10.826658 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:27:10.826658 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:27:10.826658 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:27:10.826658 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:27:10.826658 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 16:27:10.827502 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 16:27:10.827502 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 16:27:10.827502 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Aug 09 16:27:10.834150 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 272/525] 10.222.0.104 () {56 vars in 1113 bytes} [Tue Aug 9 16:27:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 16:27:10.835364 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3f3357-0fa4-4414-8504-49dc2c66ddfe None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:10.882541 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:10.892479 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e58207-bac9-4153-87b2-0b3fced34f98 None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:10.899488 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:10.929674 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fed407-dc57-4d17-adfe-563bc5f1fd1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:10.930336 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fed407-dc57-4d17-adfe-563bc5f1fd1a None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:10.930618 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fed407-dc57-4d17-adfe-563bc5f1fd1a None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:10.930893 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fed407-dc57-4d17-adfe-563bc5f1fd1a None admin] PATH_INFO: `/v3/projects` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:10.931891 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fed407-dc57-4d17-adfe-563bc5f1fd1a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:27:10.932348 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fed407-dc57-4d17-adfe-563bc5f1fd1a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:10.933691 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fed407-dc57-4d17-adfe-563bc5f1fd1a None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:10.947290 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3f3357-0fa4-4414-8504-49dc2c66ddfe None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:10.953310 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 254/526] 10.222.0.104 () {56 vars in 1153 bytes} [Tue Aug 9 16:27:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:27:10.959092 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fed407-dc57-4d17-adfe-563bc5f1fd1a None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:10.983983 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fd2e64-5137-4ea4-8dee-002f2386b5c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:10.984905 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fd2e64-5137-4ea4-8dee-002f2386b5c3 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:10.985406 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fd2e64-5137-4ea4-8dee-002f2386b5c3 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:10.986078 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fd2e64-5137-4ea4-8dee-002f2386b5c3 None admin] PATH_INFO: `/v3/domains` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:10.986902 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fd2e64-5137-4ea4-8dee-002f2386b5c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:27:10.987409 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fd2e64-5137-4ea4-8dee-002f2386b5c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:10.988964 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fd2e64-5137-4ea4-8dee-002f2386b5c3 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:11.004861 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 273/527] 10.222.0.104 () {56 vars in 1114 bytes} [Tue Aug 9 16:27:10 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:27:11.006030 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fd2e64-5137-4ea4-8dee-002f2386b5c3 None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:11.069149 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fed407-dc57-4d17-adfe-563bc5f1fd1a None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:11.106240 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acb8ba3-a903-40e3-9884-0e431655d442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:11.106892 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acb8ba3-a903-40e3-9884-0e431655d442 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:11.107171 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acb8ba3-a903-40e3-9884-0e431655d442 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:11.107442 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acb8ba3-a903-40e3-9884-0e431655d442 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:11.108219 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acb8ba3-a903-40e3-9884-0e431655d442 None admin] RBAC: Adding query filter params (role.id=aa624ab843384e48873a8d5a72422836, scope.project.id=63557f0ff1ce4ae49899b4627bafd94e, user.id=e914013dfd8b448e8cdbd6b8399cfd0c) {{(pid=87276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:27:11.108600 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acb8ba3-a903-40e3-9884-0e431655d442 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:11.109977 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acb8ba3-a903-40e3-9884-0e431655d442 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:11.116079 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fd2e64-5137-4ea4-8dee-002f2386b5c3 None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:11.122397 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 255/528] 10.222.0.104 () {56 vars in 1379 bytes} [Tue Aug 9 16:27:10 2022] GET /identity/v3/role_assignments?user.id=e914013dfd8b448e8cdbd6b8399cfd0c&scope.project.id=63557f0ff1ce4ae49899b4627bafd94e&role.id=aa624ab843384e48873a8d5a72422836 => generated 260 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 16:27:11.134411 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:11.157505 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5858768a-010f-4822-a81b-af1c3a549899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:11.158555 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5858768a-010f-4822-a81b-af1c3a549899 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:11.159054 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5858768a-010f-4822-a81b-af1c3a549899 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:11.159547 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5858768a-010f-4822-a81b-af1c3a549899 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:11.167601 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5858768a-010f-4822-a81b-af1c3a549899 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:11.169483 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5858768a-010f-4822-a81b-af1c3a549899 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:11.182892 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application [None req-5858768a-010f-4822-a81b-af1c3a549899 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 16:27:11.182892 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:27:11.182892 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:27:11.182892 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:27:11.182892 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:27:11.182892 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:27:11.182892 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:27:11.182892 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:27:11.182892 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:27:11.182892 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:27:11.182892 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:27:11.182892 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:27:11.182892 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 16:27:11.182892 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 16:27:11.182892 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 16:27:11.184352 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 16:27:11.184352 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:27:11.184352 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:27:11.184352 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:27:11.184352 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:27:11.184352 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:27:11.184352 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:27:11.184352 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:27:11.184352 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application with Lock( Aug 09 16:27:11.184352 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:27:11.184352 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:27:11.184352 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:27:11.184352 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:27:11.184352 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:27:11.184352 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:27:11.184352 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:27:11.184352 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:27:11.185190 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 16:27:11.185190 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 16:27:11.185190 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 16:27:11.185190 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 16:27:11.185190 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 16:27:11.185190 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 16:27:11.185190 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 16:27:11.185190 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Aug 09 16:27:11.187796 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 274/529] 10.222.0.104 () {56 vars in 1116 bytes} [Tue Aug 9 16:27:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 16:27:11.193732 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acb8ba3-a903-40e3-9884-0e431655d442 None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:11.215655 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:11.311093 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acb8ba3-a903-40e3-9884-0e431655d442 None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:11.355420 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c52eb3-de23-4e01-ad25-99862448a4f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:11.356079 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c52eb3-de23-4e01-ad25-99862448a4f9 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:11.356870 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c52eb3-de23-4e01-ad25-99862448a4f9 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:11.357145 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c52eb3-de23-4e01-ad25-99862448a4f9 None admin] PATH_INFO: `/v3/projects` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:11.357837 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c52eb3-de23-4e01-ad25-99862448a4f9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:27:11.358176 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c52eb3-de23-4e01-ad25-99862448a4f9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:11.359606 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c52eb3-de23-4e01-ad25-99862448a4f9 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:11.372772 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 256/530] 10.222.0.104 () {56 vars in 1153 bytes} [Tue Aug 9 16:27:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:27:11.378586 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5858768a-010f-4822-a81b-af1c3a549899 None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:11.480636 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5858768a-010f-4822-a81b-af1c3a549899 None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:11.514891 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027b45d7-8843-4f22-aa24-af7567bf9dd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:11.515863 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027b45d7-8843-4f22-aa24-af7567bf9dd5 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:11.516334 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027b45d7-8843-4f22-aa24-af7567bf9dd5 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:11.516817 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027b45d7-8843-4f22-aa24-af7567bf9dd5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:11.517781 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027b45d7-8843-4f22-aa24-af7567bf9dd5 None admin] RBAC: Adding query filter params (role.id=aa624ab843384e48873a8d5a72422836, scope.project.id=63557f0ff1ce4ae49899b4627bafd94e, user.id=da49ba8d1a21406eac55503b42fea65b) {{(pid=87275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:27:11.518326 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027b45d7-8843-4f22-aa24-af7567bf9dd5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:11.519936 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027b45d7-8843-4f22-aa24-af7567bf9dd5 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:11.526135 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 275/531] 10.222.0.104 () {56 vars in 1379 bytes} [Tue Aug 9 16:27:11 2022] GET /identity/v3/role_assignments?user.id=da49ba8d1a21406eac55503b42fea65b&scope.project.id=63557f0ff1ce4ae49899b4627bafd94e&role.id=aa624ab843384e48873a8d5a72422836 => generated 260 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:27:12.413612 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b8aadb-d079-43cf-83dd-9253f6221d8e None None] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:12.414158 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b8aadb-d079-43cf-83dd-9253f6221d8e None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:12.414158 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b8aadb-d079-43cf-83dd-9253f6221d8e None None] PATH_INFO: `/` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:12.415736 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 257/532] 10.222.0.104 () {54 vars in 932 bytes} [Tue Aug 9 16:27:12 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:27:12.421028 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d75f5d-212b-4ef6-b8ed-08243f5a4166 None None] REQUEST_METHOD: `POST` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:12.421450 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d75f5d-212b-4ef6-b8ed-08243f5a4166 None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:12.421633 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d75f5d-212b-4ef6-b8ed-08243f5a4166 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:12.440332 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.auth.core [None req-35d75f5d-212b-4ef6-b8ed-08243f5a4166 None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:27:12.441533 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.fernet_utils [None req-35d75f5d-212b-4ef6-b8ed-08243f5a4166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:27:12.472778 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:12.524851 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 276/533] 10.222.0.104 () {58 vars in 1029 bytes} [Tue Aug 9 16:27:12 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 16:27:12.549172 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b8aadb-d079-43cf-83dd-9253f6221d8e None None] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:12.636274 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:12.662690 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b8aadb-d079-43cf-83dd-9253f6221d8e None None] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:12.700433 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cc8998-18cd-494d-a926-0150926af64c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:12.701400 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cc8998-18cd-494d-a926-0150926af64c None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:12.701930 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cc8998-18cd-494d-a926-0150926af64c None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:12.702407 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cc8998-18cd-494d-a926-0150926af64c None admin] PATH_INFO: `/v3/roles/service` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:12.713231 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cc8998-18cd-494d-a926-0150926af64c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 16:27:12.718421 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application [None req-79cc8998-18cd-494d-a926-0150926af64c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 16:27:12.718421 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:27:12.718421 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:27:12.718421 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:27:12.718421 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:27:12.718421 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:27:12.718421 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:27:12.718421 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:27:12.718421 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:27:12.718421 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:27:12.718421 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:27:12.718421 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:27:12.718421 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 16:27:12.718421 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 16:27:12.718421 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 16:27:12.718421 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 16:27:12.719349 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 16:27:12.719349 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 16:27:12.719349 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 16:27:12.719349 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 16:27:12.719349 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:27:12.719349 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:27:12.719349 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:27:12.719349 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:27:12.719349 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:27:12.719349 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:27:12.719349 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:27:12.719349 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application with Lock( Aug 09 16:27:12.719349 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:27:12.719349 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:27:12.719349 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:27:12.719349 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:27:12.720157 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:27:12.720157 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:27:12.720157 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:27:12.720157 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:27:12.720157 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 16:27:12.720157 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 16:27:12.720157 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 16:27:12.720157 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 16:27:12.720157 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 16:27:12.720157 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 16:27:12.720157 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 16:27:12.720157 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Aug 09 16:27:12.722943 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 258/534] 10.222.0.104 () {56 vars in 1107 bytes} [Tue Aug 9 16:27:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 16:27:12.729942 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d75f5d-212b-4ef6-b8ed-08243f5a4166 None None] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:12.736549 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e042839-2cbf-40c4-9344-2ed1e287edf6 None None] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:12.736849 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e042839-2cbf-40c4-9344-2ed1e287edf6 None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:12.737102 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e042839-2cbf-40c4-9344-2ed1e287edf6 None None] PATH_INFO: `/` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:12.738490 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 259/535] 10.222.0.104 () {54 vars in 932 bytes} [Tue Aug 9 16:27:12 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 09 16:27:12.744071 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd9c8ed-7292-4ded-aad3-a94cea9da637 None None] REQUEST_METHOD: `POST` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:12.744357 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd9c8ed-7292-4ded-aad3-a94cea9da637 None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:12.744632 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd9c8ed-7292-4ded-aad3-a94cea9da637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:12.768151 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.auth.core [None req-bfd9c8ed-7292-4ded-aad3-a94cea9da637 None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:27:12.769408 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.fernet_utils [None req-bfd9c8ed-7292-4ded-aad3-a94cea9da637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:27:12.842670 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d75f5d-212b-4ef6-b8ed-08243f5a4166 None None] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:12.862856 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 260/536] 10.222.0.104 () {58 vars in 1029 bytes} [Tue Aug 9 16:27:12 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 16:27:12.882905 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34e49ea-ece5-40a2-8964-3755f4cd3013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:12.883519 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34e49ea-ece5-40a2-8964-3755f4cd3013 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:12.883799 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34e49ea-ece5-40a2-8964-3755f4cd3013 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:12.884072 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34e49ea-ece5-40a2-8964-3755f4cd3013 None admin] PATH_INFO: `/v3/roles` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:12.884749 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34e49ea-ece5-40a2-8964-3755f4cd3013 None admin] RBAC: Adding query filter params (name=service) {{(pid=87275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:27:12.885053 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34e49ea-ece5-40a2-8964-3755f4cd3013 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:12.887223 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd9c8ed-7292-4ded-aad3-a94cea9da637 None None] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:12.890962 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34e49ea-ece5-40a2-8964-3755f4cd3013 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:12.900416 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 277/537] 10.222.0.104 () {56 vars in 1108 bytes} [Tue Aug 9 16:27:12 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:27:12.913843 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34e49ea-ece5-40a2-8964-3755f4cd3013 None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:12.938364 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:12.981048 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:13.015392 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34e49ea-ece5-40a2-8964-3755f4cd3013 None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:13.023019 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd9c8ed-7292-4ded-aad3-a94cea9da637 None None] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:13.061876 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b53629-243a-461d-ba13-3fc9b8330608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:13.062916 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b53629-243a-461d-ba13-3fc9b8330608 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:13.063421 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b53629-243a-461d-ba13-3fc9b8330608 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:13.063905 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b53629-243a-461d-ba13-3fc9b8330608 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:13.067889 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad88b70c-311e-4571-884a-7adbc6da0f10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:13.068520 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad88b70c-311e-4571-884a-7adbc6da0f10 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:13.068802 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad88b70c-311e-4571-884a-7adbc6da0f10 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:13.069073 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad88b70c-311e-4571-884a-7adbc6da0f10 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:13.076847 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b53629-243a-461d-ba13-3fc9b8330608 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:13.078754 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b53629-243a-461d-ba13-3fc9b8330608 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:13.081399 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad88b70c-311e-4571-884a-7adbc6da0f10 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 16:27:13.088024 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application [None req-ad88b70c-311e-4571-884a-7adbc6da0f10 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 16:27:13.088024 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:27:13.088024 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:27:13.088024 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:27:13.088024 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:27:13.088024 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:27:13.088024 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:27:13.088024 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:27:13.088024 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:27:13.088024 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:27:13.088024 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:27:13.088024 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:27:13.088024 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 16:27:13.088024 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 16:27:13.088024 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 16:27:13.088024 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 16:27:13.088956 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 16:27:13.088956 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 16:27:13.088956 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 16:27:13.088956 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 16:27:13.088956 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:27:13.088956 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:27:13.088956 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:27:13.088956 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:27:13.088956 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:27:13.088956 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:27:13.088956 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:27:13.088956 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application with Lock( Aug 09 16:27:13.088956 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:27:13.088956 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:27:13.088956 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:27:13.088956 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:27:13.089826 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:27:13.089826 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:27:13.089826 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:27:13.089826 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:27:13.089826 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 16:27:13.089826 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 16:27:13.089826 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 16:27:13.089826 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 16:27:13.089826 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 16:27:13.089826 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 16:27:13.089826 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 16:27:13.089826 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Aug 09 16:27:13.092490 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 261/538] 10.222.0.104 () {56 vars in 1107 bytes} [Tue Aug 9 16:27:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 16:27:13.100659 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad88b70c-311e-4571-884a-7adbc6da0f10 None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:13.100795 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application [None req-41b53629-243a-461d-ba13-3fc9b8330608 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 16:27:13.100795 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:27:13.100795 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:27:13.100795 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:27:13.100795 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:27:13.100795 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:27:13.100795 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:27:13.100795 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:27:13.100795 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:27:13.100795 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:27:13.100795 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:27:13.100795 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:27:13.100795 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 16:27:13.100795 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 16:27:13.100795 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 16:27:13.100795 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 16:27:13.101669 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:27:13.101669 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:27:13.101669 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:27:13.101669 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:27:13.101669 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:27:13.101669 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:27:13.101669 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:27:13.101669 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application with Lock( Aug 09 16:27:13.101669 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:27:13.101669 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:27:13.101669 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:27:13.101669 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:27:13.101669 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:27:13.101669 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:27:13.101669 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:27:13.101669 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:27:13.101669 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 16:27:13.102554 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 16:27:13.102554 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 16:27:13.102554 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Aug 09 16:27:13.104167 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 278/539] 10.222.0.104 () {56 vars in 1113 bytes} [Tue Aug 9 16:27:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 16:27:13.106468 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b53629-243a-461d-ba13-3fc9b8330608 None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:13.223813 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:13.225888 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad88b70c-311e-4571-884a-7adbc6da0f10 None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:13.249200 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b53629-243a-461d-ba13-3fc9b8330608 None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:13.262346 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:13.275396 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2130ab3-bfa1-400d-ace1-a7b519cf57c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:13.277723 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2130ab3-bfa1-400d-ace1-a7b519cf57c6 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:13.278209 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2130ab3-bfa1-400d-ace1-a7b519cf57c6 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:13.278647 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2130ab3-bfa1-400d-ace1-a7b519cf57c6 None admin] PATH_INFO: `/v3/roles` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:13.279816 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2130ab3-bfa1-400d-ace1-a7b519cf57c6 None admin] RBAC: Adding query filter params (name=service) {{(pid=87276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:27:13.280301 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2130ab3-bfa1-400d-ace1-a7b519cf57c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:13.283152 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2130ab3-bfa1-400d-ace1-a7b519cf57c6 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:13.295030 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caf6e21-aa54-4337-8c87-b3d222e63e80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:13.295994 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caf6e21-aa54-4337-8c87-b3d222e63e80 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:13.296363 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caf6e21-aa54-4337-8c87-b3d222e63e80 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:13.296539 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 262/540] 10.222.0.104 () {56 vars in 1108 bytes} [Tue Aug 9 16:27:13 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:27:13.296740 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caf6e21-aa54-4337-8c87-b3d222e63e80 None admin] PATH_INFO: `/v3/domains` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:13.297478 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9caf6e21-aa54-4337-8c87-b3d222e63e80 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:27:13.297886 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9caf6e21-aa54-4337-8c87-b3d222e63e80 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:13.299529 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9caf6e21-aa54-4337-8c87-b3d222e63e80 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:13.301770 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2130ab3-bfa1-400d-ace1-a7b519cf57c6 None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:13.325995 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 279/541] 10.222.0.104 () {56 vars in 1114 bytes} [Tue Aug 9 16:27:13 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:27:13.329126 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caf6e21-aa54-4337-8c87-b3d222e63e80 None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:13.428319 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2130ab3-bfa1-400d-ace1-a7b519cf57c6 None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:13.467025 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eddb1b2-0599-405a-bb6b-848c3c67f402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:13.467736 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eddb1b2-0599-405a-bb6b-848c3c67f402 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:13.468019 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eddb1b2-0599-405a-bb6b-848c3c67f402 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:13.468291 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eddb1b2-0599-405a-bb6b-848c3c67f402 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:13.468979 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caf6e21-aa54-4337-8c87-b3d222e63e80 None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:13.481818 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eddb1b2-0599-405a-bb6b-848c3c67f402 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:13.484198 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eddb1b2-0599-405a-bb6b-848c3c67f402 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:13.503220 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application [None req-8eddb1b2-0599-405a-bb6b-848c3c67f402 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 16:27:13.503220 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:27:13.503220 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:27:13.503220 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:27:13.503220 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:27:13.503220 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:27:13.503220 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:27:13.503220 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:27:13.503220 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:27:13.503220 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:27:13.503220 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:27:13.503220 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:27:13.503220 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 16:27:13.503220 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 16:27:13.503220 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 16:27:13.503220 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 16:27:13.504130 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:27:13.504130 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:27:13.504130 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:27:13.504130 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:27:13.504130 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:27:13.504130 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:27:13.504130 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:27:13.504130 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application with Lock( Aug 09 16:27:13.504130 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:27:13.504130 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:27:13.504130 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:27:13.504130 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:27:13.504130 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:27:13.504130 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:27:13.504130 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:27:13.504130 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:27:13.504130 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 16:27:13.509542 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 16:27:13.509542 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 16:27:13.509542 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Aug 09 16:27:13.509542 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 263/542] 10.222.0.104 () {56 vars in 1113 bytes} [Tue Aug 9 16:27:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 16:27:13.510555 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb796522-6cf4-4c71-a276-bbc70716a078 None None] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:13.510901 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb796522-6cf4-4c71-a276-bbc70716a078 None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:13.511079 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb796522-6cf4-4c71-a276-bbc70716a078 None None] PATH_INFO: `/` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:13.512595 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 264/543] 10.222.0.104 () {54 vars in 932 bytes} [Tue Aug 9 16:27:13 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 09 16:27:13.512705 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb7e6ac-3c40-4c2f-8be0-6b396d20887d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:13.513127 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb7e6ac-3c40-4c2f-8be0-6b396d20887d None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:13.513488 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb7e6ac-3c40-4c2f-8be0-6b396d20887d None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:13.513869 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb7e6ac-3c40-4c2f-8be0-6b396d20887d None admin] PATH_INFO: `/v3/users/nova` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:13.516803 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb796522-6cf4-4c71-a276-bbc70716a078 None None] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:13.521682 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb7e6ac-3c40-4c2f-8be0-6b396d20887d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:13.523310 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb7e6ac-3c40-4c2f-8be0-6b396d20887d None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:13.537489 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application [None req-8cb7e6ac-3c40-4c2f-8be0-6b396d20887d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 09 16:27:13.537489 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:27:13.537489 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:27:13.537489 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:27:13.537489 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:27:13.537489 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:27:13.537489 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:27:13.537489 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:27:13.537489 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:27:13.537489 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:27:13.537489 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:27:13.537489 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:27:13.537489 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 16:27:13.537489 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 16:27:13.537489 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 16:27:13.537489 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 16:27:13.538456 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:27:13.538456 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:27:13.538456 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 16:27:13.538456 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 16:27:13.538456 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 16:27:13.538456 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 16:27:13.538456 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:27:13.538456 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:27:13.538456 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:27:13.538456 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:27:13.538456 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:27:13.538456 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application with Lock( Aug 09 16:27:13.538456 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:27:13.538456 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:27:13.538456 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:27:13.538456 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:27:13.538456 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:27:13.538456 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:27:13.539353 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:27:13.539353 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:27:13.539353 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 16:27:13.539353 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 16:27:13.539353 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 16:27:13.539353 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 16:27:13.539353 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 16:27:13.539353 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 16:27:13.539353 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 09 16:27:13.539353 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Aug 09 16:27:13.540753 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 280/544] 10.222.0.104 () {56 vars in 1098 bytes} [Tue Aug 9 16:27:13 2022] GET /identity/v3/users/nova => generated 82 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 16:27:13.542098 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18e2ac7-81a9-4d6a-90ca-915e51014b9a None None] REQUEST_METHOD: `POST` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:13.542448 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18e2ac7-81a9-4d6a-90ca-915e51014b9a None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:13.543341 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18e2ac7-81a9-4d6a-90ca-915e51014b9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:13.549827 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:13.562780 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.auth.core [None req-e18e2ac7-81a9-4d6a-90ca-915e51014b9a None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:27:13.563974 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.fernet_utils [None req-e18e2ac7-81a9-4d6a-90ca-915e51014b9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:27:13.567623 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:13.634035 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb796522-6cf4-4c71-a276-bbc70716a078 None None] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:13.636467 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 281/545] 10.222.0.104 () {58 vars in 1029 bytes} [Tue Aug 9 16:27:13 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 16:27:13.637281 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18e2ac7-81a9-4d6a-90ca-915e51014b9a None None] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:13.679259 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004f820a-de3d-434c-b710-73a91721581d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:13.679958 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004f820a-de3d-434c-b710-73a91721581d None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:13.680600 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004f820a-de3d-434c-b710-73a91721581d None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:13.680600 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004f820a-de3d-434c-b710-73a91721581d None admin] PATH_INFO: `/v3/domains` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:13.681636 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004f820a-de3d-434c-b710-73a91721581d None admin] RBAC: Adding query filter params (name=Default) {{(pid=87276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:27:13.681756 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004f820a-de3d-434c-b710-73a91721581d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:13.683139 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004f820a-de3d-434c-b710-73a91721581d None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:13.703013 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 265/546] 10.222.0.104 () {56 vars in 1114 bytes} [Tue Aug 9 16:27:13 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:27:13.704156 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004f820a-de3d-434c-b710-73a91721581d None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:13.752966 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18e2ac7-81a9-4d6a-90ca-915e51014b9a None None] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:13.785999 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:13.793338 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00be625d-56ae-4cb9-9cc8-b6bb6a134ab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:13.793987 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00be625d-56ae-4cb9-9cc8-b6bb6a134ab1 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:13.794273 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00be625d-56ae-4cb9-9cc8-b6bb6a134ab1 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:13.794550 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00be625d-56ae-4cb9-9cc8-b6bb6a134ab1 None admin] PATH_INFO: `/v3/users` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:13.795643 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00be625d-56ae-4cb9-9cc8-b6bb6a134ab1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:27:13.795953 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00be625d-56ae-4cb9-9cc8-b6bb6a134ab1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:13.797723 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00be625d-56ae-4cb9-9cc8-b6bb6a134ab1 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:13.821062 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 282/547] 10.222.0.104 () {56 vars in 1138 bytes} [Tue Aug 9 16:27:13 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:27:13.821062 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00be625d-56ae-4cb9-9cc8-b6bb6a134ab1 None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:13.822337 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:13.825808 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004f820a-de3d-434c-b710-73a91721581d None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:13.862999 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff76758-50f3-4511-a926-368c6c4d406e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:13.863664 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff76758-50f3-4511-a926-368c6c4d406e None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:13.863985 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff76758-50f3-4511-a926-368c6c4d406e None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:13.864298 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff76758-50f3-4511-a926-368c6c4d406e None admin] PATH_INFO: `/v3/roles/service` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:13.875338 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff76758-50f3-4511-a926-368c6c4d406e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 16:27:13.880203 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application [None req-4ff76758-50f3-4511-a926-368c6c4d406e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 16:27:13.880203 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:27:13.880203 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:27:13.880203 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:27:13.880203 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:27:13.880203 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:27:13.880203 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:27:13.880203 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:27:13.880203 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:27:13.880203 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:27:13.880203 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:27:13.880203 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:27:13.880203 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 16:27:13.880203 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 16:27:13.880203 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 16:27:13.880203 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 16:27:13.881089 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 16:27:13.881089 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 16:27:13.881089 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 16:27:13.881089 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 16:27:13.881089 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:27:13.881089 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:27:13.881089 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:27:13.881089 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:27:13.881089 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:27:13.881089 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:27:13.881089 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:27:13.881089 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application with Lock( Aug 09 16:27:13.881089 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:27:13.881089 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:27:13.881089 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:27:13.881089 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:27:13.881933 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:27:13.881933 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:27:13.881933 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:27:13.881933 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:27:13.881933 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 16:27:13.881933 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 16:27:13.881933 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 16:27:13.881933 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 16:27:13.881933 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 16:27:13.881933 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 16:27:13.881933 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 16:27:13.881933 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Aug 09 16:27:13.881933 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 266/548] 10.222.0.104 () {56 vars in 1107 bytes} [Tue Aug 9 16:27:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 16:27:13.882607 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff76758-50f3-4511-a926-368c6c4d406e None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:13.931515 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00be625d-56ae-4cb9-9cc8-b6bb6a134ab1 None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:13.965791 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ccadfa-d92e-4307-bdea-fbe7d0e5c27a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:13.966452 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ccadfa-d92e-4307-bdea-fbe7d0e5c27a None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:13.966731 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ccadfa-d92e-4307-bdea-fbe7d0e5c27a None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:13.967000 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ccadfa-d92e-4307-bdea-fbe7d0e5c27a None admin] PATH_INFO: `/v3/users/glance` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:13.973978 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ccadfa-d92e-4307-bdea-fbe7d0e5c27a None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:13.975426 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ccadfa-d92e-4307-bdea-fbe7d0e5c27a None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:13.983699 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff76758-50f3-4511-a926-368c6c4d406e None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:13.987190 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application [None req-31ccadfa-d92e-4307-bdea-fbe7d0e5c27a None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 09 16:27:13.987190 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:27:13.987190 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:27:13.987190 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:27:13.987190 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:27:13.987190 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:27:13.987190 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:27:13.987190 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:27:13.987190 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:27:13.987190 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:27:13.987190 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:27:13.987190 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:27:13.987190 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 16:27:13.987190 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 16:27:13.987190 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 16:27:13.987190 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 16:27:13.988117 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:27:13.988117 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:27:13.988117 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 16:27:13.988117 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 16:27:13.988117 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 16:27:13.988117 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 16:27:13.988117 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:27:13.988117 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:27:13.988117 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:27:13.988117 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:27:13.988117 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:27:13.988117 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application with Lock( Aug 09 16:27:13.988117 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:27:13.988117 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:27:13.988117 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:27:13.988117 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:27:13.988117 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:27:13.988117 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:27:13.989033 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:27:13.989033 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:27:13.989033 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 16:27:13.989033 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 16:27:13.989033 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 16:27:13.989033 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 16:27:13.989033 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 16:27:13.989033 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 16:27:13.989033 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 09 16:27:13.989033 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Aug 09 16:27:13.989033 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 283/549] 10.222.0.104 () {56 vars in 1104 bytes} [Tue Aug 9 16:27:13 2022] GET /identity/v3/users/glance => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 16:27:13.989033 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ccadfa-d92e-4307-bdea-fbe7d0e5c27a None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:14.020673 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e90e6e-e8a8-4d83-9db7-dd1d29860e1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:14.021223 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e90e6e-e8a8-4d83-9db7-dd1d29860e1a None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:14.021504 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e90e6e-e8a8-4d83-9db7-dd1d29860e1a None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:14.021778 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e90e6e-e8a8-4d83-9db7-dd1d29860e1a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:14.032388 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e90e6e-e8a8-4d83-9db7-dd1d29860e1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:14.033962 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e90e6e-e8a8-4d83-9db7-dd1d29860e1a None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:14.038271 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:14.049674 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application [None req-e5e90e6e-e8a8-4d83-9db7-dd1d29860e1a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 16:27:14.049674 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:27:14.049674 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:27:14.049674 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:27:14.049674 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:27:14.049674 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:27:14.049674 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:27:14.049674 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:27:14.049674 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:27:14.049674 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:27:14.049674 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:27:14.049674 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:27:14.049674 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 16:27:14.049674 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 16:27:14.049674 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 16:27:14.049674 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 16:27:14.050920 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:27:14.050920 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:27:14.050920 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:27:14.050920 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:27:14.050920 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:27:14.050920 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:27:14.050920 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:27:14.050920 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application with Lock( Aug 09 16:27:14.050920 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:27:14.050920 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:27:14.050920 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:27:14.050920 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:27:14.050920 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:27:14.050920 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:27:14.050920 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:27:14.050920 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:27:14.050920 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 16:27:14.051780 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 16:27:14.051780 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 16:27:14.051780 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Aug 09 16:27:14.055512 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 267/550] 10.222.0.104 () {56 vars in 1113 bytes} [Tue Aug 9 16:27:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 16:27:14.057152 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238f98b4-595b-49d8-8cc6-a9e7a1d3ad19 None None] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:14.057426 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238f98b4-595b-49d8-8cc6-a9e7a1d3ad19 None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:14.057695 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238f98b4-595b-49d8-8cc6-a9e7a1d3ad19 None None] PATH_INFO: `/` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:14.059087 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 268/551] 10.222.0.104 () {54 vars in 932 bytes} [Tue Aug 9 16:27:14 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:27:14.059703 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238f98b4-595b-49d8-8cc6-a9e7a1d3ad19 None None] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:14.074368 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:14.096538 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ccadfa-d92e-4307-bdea-fbe7d0e5c27a None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:14.129032 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4abb757-aec0-4f84-93cf-ae0de8e19186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:14.129626 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4abb757-aec0-4f84-93cf-ae0de8e19186 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:14.129909 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4abb757-aec0-4f84-93cf-ae0de8e19186 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:14.130206 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4abb757-aec0-4f84-93cf-ae0de8e19186 None admin] PATH_INFO: `/v3/roles` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:14.130848 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4abb757-aec0-4f84-93cf-ae0de8e19186 None admin] RBAC: Adding query filter params (name=service) {{(pid=87275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:27:14.131144 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4abb757-aec0-4f84-93cf-ae0de8e19186 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:14.132494 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4abb757-aec0-4f84-93cf-ae0de8e19186 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:14.140268 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 284/552] 10.222.0.104 () {56 vars in 1108 bytes} [Tue Aug 9 16:27:13 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:27:14.141035 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4abb757-aec0-4f84-93cf-ae0de8e19186 None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:14.160837 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238f98b4-595b-49d8-8cc6-a9e7a1d3ad19 None None] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:14.194350 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b50b75-cdcc-4ff1-8bbb-b81454b2f530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:14.194938 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b50b75-cdcc-4ff1-8bbb-b81454b2f530 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:14.195216 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b50b75-cdcc-4ff1-8bbb-b81454b2f530 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:14.195484 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b50b75-cdcc-4ff1-8bbb-b81454b2f530 None admin] PATH_INFO: `/v3/users` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:14.196200 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b50b75-cdcc-4ff1-8bbb-b81454b2f530 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=87276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:27:14.196504 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b50b75-cdcc-4ff1-8bbb-b81454b2f530 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:14.198095 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b50b75-cdcc-4ff1-8bbb-b81454b2f530 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:14.215117 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 269/553] 10.222.0.104 () {56 vars in 1142 bytes} [Tue Aug 9 16:27:14 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 374 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:27:14.216389 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abaaad8-b564-4aef-9820-8231a88f0c7b None None] REQUEST_METHOD: `POST` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:14.216674 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abaaad8-b564-4aef-9820-8231a88f0c7b None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:14.216969 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abaaad8-b564-4aef-9820-8231a88f0c7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:14.234767 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.auth.core [None req-8abaaad8-b564-4aef-9820-8231a88f0c7b None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:27:14.235951 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.fernet_utils [None req-8abaaad8-b564-4aef-9820-8231a88f0c7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:27:14.242549 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4abb757-aec0-4f84-93cf-ae0de8e19186 None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:14.255641 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:14.276634 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a599c94-c7ca-4494-8ef5-f8bbb6cb0a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:14.277675 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a599c94-c7ca-4494-8ef5-f8bbb6cb0a1f None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:14.277982 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a599c94-c7ca-4494-8ef5-f8bbb6cb0a1f None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:14.278256 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a599c94-c7ca-4494-8ef5-f8bbb6cb0a1f None admin] PATH_INFO: `/v3/domains` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:14.278888 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a599c94-c7ca-4494-8ef5-f8bbb6cb0a1f None admin] RBAC: Adding query filter params (name=Default) {{(pid=87275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:27:14.279189 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a599c94-c7ca-4494-8ef5-f8bbb6cb0a1f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:14.280541 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a599c94-c7ca-4494-8ef5-f8bbb6cb0a1f None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:14.291984 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 285/554] 10.222.0.104 () {56 vars in 1114 bytes} [Tue Aug 9 16:27:14 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:27:14.293327 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a599c94-c7ca-4494-8ef5-f8bbb6cb0a1f None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:14.297771 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:14.303267 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 270/555] 10.222.0.104 () {58 vars in 1029 bytes} [Tue Aug 9 16:27:14 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 16:27:14.304116 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abaaad8-b564-4aef-9820-8231a88f0c7b None None] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:14.404410 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a599c94-c7ca-4494-8ef5-f8bbb6cb0a1f None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:14.406077 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abaaad8-b564-4aef-9820-8231a88f0c7b None None] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:14.440034 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0955b93e-7142-496d-9e9f-2ac60a1c23cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:14.440653 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0955b93e-7142-496d-9e9f-2ac60a1c23cd None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:14.440925 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0955b93e-7142-496d-9e9f-2ac60a1c23cd None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:14.441182 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85a816e-2528-4a6a-adf8-438eece3c365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:14.441627 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0955b93e-7142-496d-9e9f-2ac60a1c23cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:14.441812 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85a816e-2528-4a6a-adf8-438eece3c365 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:14.442133 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85a816e-2528-4a6a-adf8-438eece3c365 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:14.442408 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85a816e-2528-4a6a-adf8-438eece3c365 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:14.451799 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0955b93e-7142-496d-9e9f-2ac60a1c23cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:14.453138 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85a816e-2528-4a6a-adf8-438eece3c365 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:14.453320 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0955b93e-7142-496d-9e9f-2ac60a1c23cd None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:14.454595 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85a816e-2528-4a6a-adf8-438eece3c365 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:14.468345 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application [None req-0955b93e-7142-496d-9e9f-2ac60a1c23cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 16:27:14.468345 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:27:14.468345 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:27:14.468345 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:27:14.468345 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:27:14.468345 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:27:14.468345 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:27:14.468345 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:27:14.468345 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:27:14.468345 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:27:14.468345 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:27:14.468345 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:27:14.468345 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 16:27:14.468345 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 16:27:14.468345 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 16:27:14.468345 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 16:27:14.469711 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:27:14.469711 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:27:14.469711 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:27:14.469711 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:27:14.469711 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:27:14.469711 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:27:14.469711 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:27:14.469711 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application with Lock( Aug 09 16:27:14.469711 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:27:14.469711 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:27:14.469711 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:27:14.469711 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:27:14.469711 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:27:14.469711 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:27:14.469711 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:27:14.469711 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:27:14.469711 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 16:27:14.475296 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 16:27:14.475296 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 16:27:14.475296 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Aug 09 16:27:14.475296 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 286/556] 10.222.0.104 () {56 vars in 1113 bytes} [Tue Aug 9 16:27:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 16:27:14.475581 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application [None req-e85a816e-2528-4a6a-adf8-438eece3c365 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 16:27:14.475581 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:27:14.475581 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:27:14.475581 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:27:14.475581 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:27:14.475581 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:27:14.475581 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:27:14.475581 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:27:14.475581 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:27:14.475581 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:27:14.475581 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:27:14.475581 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:27:14.475581 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 16:27:14.475581 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 16:27:14.475581 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 16:27:14.475581 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 16:27:14.476632 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:27:14.476632 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:27:14.476632 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:27:14.476632 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:27:14.476632 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:27:14.476632 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:27:14.476632 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:27:14.476632 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application with Lock( Aug 09 16:27:14.476632 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:27:14.476632 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:27:14.476632 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:27:14.476632 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:27:14.476632 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:27:14.476632 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:27:14.476632 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:27:14.476632 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:27:14.476632 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 16:27:14.477739 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 16:27:14.477739 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 16:27:14.477739 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Aug 09 16:27:14.478113 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0955b93e-7142-496d-9e9f-2ac60a1c23cd None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:14.478195 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 271/557] 10.222.0.104 () {56 vars in 1113 bytes} [Tue Aug 9 16:27:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 16:27:14.478195 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85a816e-2528-4a6a-adf8-438eece3c365 None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:14.501258 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:14.524342 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:14.573038 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85a816e-2528-4a6a-adf8-438eece3c365 None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:14.576341 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0955b93e-7142-496d-9e9f-2ac60a1c23cd None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:14.606255 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7a14c8-d40a-4cd5-947d-d1ff409a37e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:14.606878 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7a14c8-d40a-4cd5-947d-d1ff409a37e2 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:14.607155 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7a14c8-d40a-4cd5-947d-d1ff409a37e2 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:14.607424 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7a14c8-d40a-4cd5-947d-d1ff409a37e2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:14.611519 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a0a4b8-ee0c-4ca3-ab9d-a45d0b27707a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:14.612147 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a0a4b8-ee0c-4ca3-ab9d-a45d0b27707a None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:14.612425 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a0a4b8-ee0c-4ca3-ab9d-a45d0b27707a None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:14.612754 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a0a4b8-ee0c-4ca3-ab9d-a45d0b27707a None admin] PATH_INFO: `/v3/projects/service` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:14.617285 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7a14c8-d40a-4cd5-947d-d1ff409a37e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 16:27:14.619161 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a0a4b8-ee0c-4ca3-ab9d-a45d0b27707a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:14.620605 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a0a4b8-ee0c-4ca3-ab9d-a45d0b27707a None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:14.622912 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application [None req-ff7a14c8-d40a-4cd5-947d-d1ff409a37e2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 16:27:14.622912 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:27:14.622912 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:27:14.622912 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:27:14.622912 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:27:14.622912 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:27:14.622912 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:27:14.622912 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:27:14.622912 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:27:14.622912 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:27:14.622912 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:27:14.622912 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:27:14.622912 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 16:27:14.622912 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 16:27:14.622912 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 16:27:14.622912 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 16:27:14.624246 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 16:27:14.624246 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 16:27:14.624246 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 16:27:14.624246 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 16:27:14.624246 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:27:14.624246 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:27:14.624246 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:27:14.624246 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:27:14.624246 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:27:14.624246 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:27:14.624246 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:27:14.624246 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application with Lock( Aug 09 16:27:14.624246 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:27:14.624246 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:27:14.624246 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:27:14.624246 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:27:14.625071 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:27:14.625071 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:27:14.625071 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:27:14.625071 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:27:14.625071 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 16:27:14.625071 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 16:27:14.625071 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 16:27:14.625071 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 16:27:14.625071 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 16:27:14.625071 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 16:27:14.625071 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 16:27:14.625071 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Aug 09 16:27:14.625071 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 272/558] 10.222.0.104 () {56 vars in 1107 bytes} [Tue Aug 9 16:27:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 16:27:14.625071 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7a14c8-d40a-4cd5-947d-d1ff409a37e2 None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:14.632379 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application [None req-79a0a4b8-ee0c-4ca3-ab9d-a45d0b27707a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 16:27:14.632379 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:27:14.632379 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:27:14.632379 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:27:14.632379 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:27:14.632379 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:27:14.632379 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:27:14.632379 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:27:14.632379 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:27:14.632379 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:27:14.632379 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:27:14.632379 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:27:14.632379 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 16:27:14.632379 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 16:27:14.632379 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 16:27:14.633399 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 16:27:14.633399 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:27:14.633399 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:27:14.633399 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:27:14.633399 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:27:14.633399 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:27:14.633399 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:27:14.633399 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:27:14.633399 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application with Lock( Aug 09 16:27:14.633399 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:27:14.633399 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:27:14.633399 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:27:14.633399 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:27:14.633399 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:27:14.633399 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:27:14.633399 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:27:14.633399 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:27:14.634305 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 16:27:14.634305 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 16:27:14.634305 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 16:27:14.634305 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 16:27:14.634305 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 16:27:14.634305 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 16:27:14.634305 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 16:27:14.634305 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Aug 09 16:27:14.634305 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 287/559] 10.222.0.104 () {56 vars in 1116 bytes} [Tue Aug 9 16:27:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 16:27:14.634305 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a0a4b8-ee0c-4ca3-ab9d-a45d0b27707a None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:14.717428 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:14.729705 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7a14c8-d40a-4cd5-947d-d1ff409a37e2 None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:14.733176 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a0a4b8-ee0c-4ca3-ab9d-a45d0b27707a None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:14.743275 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:14.765853 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae25e91-ae8f-40f6-a0ed-41bb28e0b044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:14.766001 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae25e91-ae8f-40f6-a0ed-41bb28e0b044 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:14.766207 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae25e91-ae8f-40f6-a0ed-41bb28e0b044 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:14.766478 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae25e91-ae8f-40f6-a0ed-41bb28e0b044 None admin] PATH_INFO: `/v3/domains` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:14.766585 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63fc438-2d96-4dd3-8769-6f59b499394b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:14.767115 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae25e91-ae8f-40f6-a0ed-41bb28e0b044 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:27:14.767210 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63fc438-2d96-4dd3-8769-6f59b499394b None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:14.767417 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae25e91-ae8f-40f6-a0ed-41bb28e0b044 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:14.767516 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63fc438-2d96-4dd3-8769-6f59b499394b None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:14.767704 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63fc438-2d96-4dd3-8769-6f59b499394b None admin] PATH_INFO: `/v3/domains` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:14.768334 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63fc438-2d96-4dd3-8769-6f59b499394b None admin] RBAC: Adding query filter params (name=Default) {{(pid=87275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:27:14.768633 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63fc438-2d96-4dd3-8769-6f59b499394b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:14.768798 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae25e91-ae8f-40f6-a0ed-41bb28e0b044 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:14.770015 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63fc438-2d96-4dd3-8769-6f59b499394b None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:14.782488 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 288/560] 10.222.0.104 () {56 vars in 1114 bytes} [Tue Aug 9 16:27:14 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:27:14.783032 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 273/561] 10.222.0.104 () {56 vars in 1114 bytes} [Tue Aug 9 16:27:14 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:27:14.783286 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63fc438-2d96-4dd3-8769-6f59b499394b None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:14.783778 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae25e91-ae8f-40f6-a0ed-41bb28e0b044 None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:14.882158 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae25e91-ae8f-40f6-a0ed-41bb28e0b044 None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:14.886379 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63fc438-2d96-4dd3-8769-6f59b499394b None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:14.916527 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b4df35-b6dc-40b7-8549-1207742ea882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:14.917126 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b4df35-b6dc-40b7-8549-1207742ea882 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:14.917453 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b4df35-b6dc-40b7-8549-1207742ea882 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:14.918242 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b4df35-b6dc-40b7-8549-1207742ea882 None admin] PATH_INFO: `/v3/projects` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:14.918924 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b4df35-b6dc-40b7-8549-1207742ea882 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:27:14.919228 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b4df35-b6dc-40b7-8549-1207742ea882 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:14.920197 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7131d2-ab3c-4d46-8178-d22a1a8114d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:14.920650 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b4df35-b6dc-40b7-8549-1207742ea882 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:14.920799 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7131d2-ab3c-4d46-8178-d22a1a8114d2 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:14.921074 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7131d2-ab3c-4d46-8178-d22a1a8114d2 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:14.921343 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7131d2-ab3c-4d46-8178-d22a1a8114d2 None admin] PATH_INFO: `/v3/roles` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:14.922029 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7131d2-ab3c-4d46-8178-d22a1a8114d2 None admin] RBAC: Adding query filter params (name=service) {{(pid=87275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:27:14.922331 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7131d2-ab3c-4d46-8178-d22a1a8114d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:14.923706 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7131d2-ab3c-4d46-8178-d22a1a8114d2 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:14.932485 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 289/562] 10.222.0.104 () {56 vars in 1108 bytes} [Tue Aug 9 16:27:14 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:27:14.937451 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 274/563] 10.222.0.104 () {56 vars in 1153 bytes} [Tue Aug 9 16:27:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:27:14.937552 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7131d2-ab3c-4d46-8178-d22a1a8114d2 None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:14.937852 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b4df35-b6dc-40b7-8549-1207742ea882 None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:14.945854 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:14.966122 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:15.034620 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b4df35-b6dc-40b7-8549-1207742ea882 None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:15.037610 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7131d2-ab3c-4d46-8178-d22a1a8114d2 None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:15.070211 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d44ee9-fc22-4078-9fae-95359b69551c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:15.070845 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d44ee9-fc22-4078-9fae-95359b69551c None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:15.071125 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d44ee9-fc22-4078-9fae-95359b69551c None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:15.071409 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d44ee9-fc22-4078-9fae-95359b69551c None admin] PATH_INFO: `/v3/projects/service` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:15.076255 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15c2ec3-8018-4e09-8c0b-1156d6a1b877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:15.076873 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15c2ec3-8018-4e09-8c0b-1156d6a1b877 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:15.077147 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15c2ec3-8018-4e09-8c0b-1156d6a1b877 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:15.077417 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15c2ec3-8018-4e09-8c0b-1156d6a1b877 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:15.078220 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d44ee9-fc22-4078-9fae-95359b69551c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:15.079648 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d44ee9-fc22-4078-9fae-95359b69551c None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:15.084786 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15c2ec3-8018-4e09-8c0b-1156d6a1b877 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:15.086241 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15c2ec3-8018-4e09-8c0b-1156d6a1b877 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:15.091099 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application [None req-31d44ee9-fc22-4078-9fae-95359b69551c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 16:27:15.091099 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:27:15.091099 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:27:15.091099 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:27:15.091099 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:27:15.091099 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:27:15.091099 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:27:15.091099 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:27:15.091099 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:27:15.091099 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:27:15.091099 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:27:15.091099 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:27:15.091099 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 16:27:15.091099 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 16:27:15.091099 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 16:27:15.092189 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 16:27:15.092189 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:27:15.092189 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:27:15.092189 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:27:15.092189 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:27:15.092189 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:27:15.092189 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:27:15.092189 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:27:15.092189 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application with Lock( Aug 09 16:27:15.092189 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:27:15.092189 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:27:15.092189 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:27:15.092189 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:27:15.092189 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:27:15.092189 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:27:15.092189 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:27:15.092189 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:27:15.093082 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 16:27:15.093082 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 16:27:15.093082 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 16:27:15.093082 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 16:27:15.093082 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 16:27:15.093082 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 16:27:15.093082 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 16:27:15.093082 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Aug 09 16:27:15.093082 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 275/564] 10.222.0.104 () {56 vars in 1116 bytes} [Tue Aug 9 16:27:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 16:27:15.093589 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d44ee9-fc22-4078-9fae-95359b69551c None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:15.099033 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application [None req-a15c2ec3-8018-4e09-8c0b-1156d6a1b877 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 09 16:27:15.099033 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:27:15.099033 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:27:15.099033 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:27:15.099033 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:27:15.099033 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:27:15.099033 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:27:15.099033 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:27:15.099033 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:27:15.099033 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:27:15.099033 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:27:15.099033 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:27:15.099033 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 16:27:15.099033 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 16:27:15.099033 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 16:27:15.099033 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 16:27:15.100174 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:27:15.100174 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:27:15.100174 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 16:27:15.100174 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 16:27:15.100174 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 16:27:15.100174 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 16:27:15.100174 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:27:15.100174 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:27:15.100174 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:27:15.100174 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:27:15.100174 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:27:15.100174 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application with Lock( Aug 09 16:27:15.100174 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:27:15.100174 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:27:15.100174 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:27:15.100174 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:27:15.100174 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:27:15.100174 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:27:15.101125 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:27:15.101125 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:27:15.101125 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 16:27:15.101125 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 16:27:15.101125 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 16:27:15.101125 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 16:27:15.101125 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 16:27:15.101125 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 16:27:15.101125 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 09 16:27:15.101125 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Aug 09 16:27:15.101125 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 290/565] 10.222.0.104 () {56 vars in 1104 bytes} [Tue Aug 9 16:27:14 2022] GET /identity/v3/users/cinder => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 16:27:15.101125 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15c2ec3-8018-4e09-8c0b-1156d6a1b877 None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:15.169618 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:15.184653 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:15.194097 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d44ee9-fc22-4078-9fae-95359b69551c None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:15.206667 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15c2ec3-8018-4e09-8c0b-1156d6a1b877 None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:15.228256 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5950c7c6-b9b7-4318-bac6-20d0b2a8c459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:15.228875 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5950c7c6-b9b7-4318-bac6-20d0b2a8c459 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:15.229150 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5950c7c6-b9b7-4318-bac6-20d0b2a8c459 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:15.229420 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5950c7c6-b9b7-4318-bac6-20d0b2a8c459 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:15.239731 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8a42bf-602a-4539-94b2-88caaa88a519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:15.240383 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8a42bf-602a-4539-94b2-88caaa88a519 None admin] REQUEST_METHOD: `PUT` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:15.240661 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8a42bf-602a-4539-94b2-88caaa88a519 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:15.240937 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8a42bf-602a-4539-94b2-88caaa88a519 None admin] PATH_INFO: `/v3/projects/63557f0ff1ce4ae49899b4627bafd94e/users/b4c33c3fc318484d9cdfae778d23f06a/roles/aa624ab843384e48873a8d5a72422836` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:15.241035 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5950c7c6-b9b7-4318-bac6-20d0b2a8c459 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:15.242427 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5950c7c6-b9b7-4318-bac6-20d0b2a8c459 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:15.255177 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8a42bf-602a-4539-94b2-88caaa88a519 None admin] RBAC: Authorizing `identity:create_grant(project_id=63557f0ff1ce4ae49899b4627bafd94e, user_id=b4c33c3fc318484d9cdfae778d23f06a, role_id=aa624ab843384e48873a8d5a72422836)` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:15.256278 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application [None req-5950c7c6-b9b7-4318-bac6-20d0b2a8c459 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 16:27:15.256278 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:27:15.256278 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:27:15.256278 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:27:15.256278 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:27:15.256278 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:27:15.256278 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:27:15.256278 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:27:15.256278 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:27:15.256278 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:27:15.256278 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:27:15.256278 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:27:15.256278 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 16:27:15.256278 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 16:27:15.256278 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 16:27:15.256278 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 16:27:15.257311 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:27:15.257311 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:27:15.257311 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:27:15.257311 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:27:15.257311 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:27:15.257311 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:27:15.257311 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:27:15.257311 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application with Lock( Aug 09 16:27:15.257311 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:27:15.257311 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:27:15.257311 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:27:15.257311 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:27:15.257311 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:27:15.257311 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:27:15.257311 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:27:15.257311 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:27:15.257311 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 16:27:15.258342 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 16:27:15.258342 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 16:27:15.258342 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Aug 09 16:27:15.258528 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8a42bf-602a-4539-94b2-88caaa88a519 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:15.258610 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 276/566] 10.222.0.104 () {56 vars in 1113 bytes} [Tue Aug 9 16:27:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 16:27:15.258610 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5950c7c6-b9b7-4318-bac6-20d0b2a8c459 None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:15.272385 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 291/567] 10.222.0.104 () {58 vars in 1444 bytes} [Tue Aug 9 16:27:15 2022] PUT /identity/v3/projects/63557f0ff1ce4ae49899b4627bafd94e/users/b4c33c3fc318484d9cdfae778d23f06a/roles/aa624ab843384e48873a8d5a72422836 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 16:27:15.273190 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8a42bf-602a-4539-94b2-88caaa88a519 None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:15.378943 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5950c7c6-b9b7-4318-bac6-20d0b2a8c459 None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:15.387326 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8a42bf-602a-4539-94b2-88caaa88a519 None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:15.406989 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:15.421820 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802bcab6-cb3b-4adc-aca4-db2ae010a1d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:15.422388 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802bcab6-cb3b-4adc-aca4-db2ae010a1d6 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:15.422668 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802bcab6-cb3b-4adc-aca4-db2ae010a1d6 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:15.422941 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802bcab6-cb3b-4adc-aca4-db2ae010a1d6 None admin] PATH_INFO: `/v3/projects` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:15.423647 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802bcab6-cb3b-4adc-aca4-db2ae010a1d6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:27:15.423958 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802bcab6-cb3b-4adc-aca4-db2ae010a1d6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:15.425429 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802bcab6-cb3b-4adc-aca4-db2ae010a1d6 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:15.429822 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb5abc9-1095-4bb7-89c9-40c2d9ffb9df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:15.430491 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb5abc9-1095-4bb7-89c9-40c2d9ffb9df None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:15.430796 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb5abc9-1095-4bb7-89c9-40c2d9ffb9df None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:15.431324 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb5abc9-1095-4bb7-89c9-40c2d9ffb9df None admin] PATH_INFO: `/v3/users` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:15.432063 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb5abc9-1095-4bb7-89c9-40c2d9ffb9df None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=87275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:27:15.432371 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb5abc9-1095-4bb7-89c9-40c2d9ffb9df None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:15.433911 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb5abc9-1095-4bb7-89c9-40c2d9ffb9df None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:15.439509 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 277/568] 10.222.0.104 () {56 vars in 1153 bytes} [Tue Aug 9 16:27:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:27:15.440584 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802bcab6-cb3b-4adc-aca4-db2ae010a1d6 None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:15.447062 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:15.457752 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 292/569] 10.222.0.104 () {56 vars in 1142 bytes} [Tue Aug 9 16:27:15 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 374 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:27:15.458917 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb5abc9-1095-4bb7-89c9-40c2d9ffb9df None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:15.560908 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802bcab6-cb3b-4adc-aca4-db2ae010a1d6 None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:15.569379 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb5abc9-1095-4bb7-89c9-40c2d9ffb9df None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:15.596945 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f0f6d3-c146-4b78-b936-2326364b16f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:15.597547 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f0f6d3-c146-4b78-b936-2326364b16f0 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:15.597825 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f0f6d3-c146-4b78-b936-2326364b16f0 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:15.598123 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f0f6d3-c146-4b78-b936-2326364b16f0 None admin] PATH_INFO: `/v3/domains` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:15.598855 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f0f6d3-c146-4b78-b936-2326364b16f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:27:15.599165 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f0f6d3-c146-4b78-b936-2326364b16f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:15.600640 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f0f6d3-c146-4b78-b936-2326364b16f0 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:15.604701 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97654748-6f51-4558-8613-3b5958ef0bd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:15.605427 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97654748-6f51-4558-8613-3b5958ef0bd1 None admin] REQUEST_METHOD: `PUT` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:15.605706 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97654748-6f51-4558-8613-3b5958ef0bd1 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:15.606017 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97654748-6f51-4558-8613-3b5958ef0bd1 None admin] PATH_INFO: `/v3/projects/63557f0ff1ce4ae49899b4627bafd94e/users/717261252a9a44de8a71c10fda7082b0/roles/aa624ab843384e48873a8d5a72422836` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:15.612347 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 278/570] 10.222.0.104 () {56 vars in 1114 bytes} [Tue Aug 9 16:27:15 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:27:15.613058 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f0f6d3-c146-4b78-b936-2326364b16f0 None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:15.627746 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97654748-6f51-4558-8613-3b5958ef0bd1 None admin] RBAC: Authorizing `identity:create_grant(project_id=63557f0ff1ce4ae49899b4627bafd94e, user_id=717261252a9a44de8a71c10fda7082b0, role_id=aa624ab843384e48873a8d5a72422836)` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:15.629194 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97654748-6f51-4558-8613-3b5958ef0bd1 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:15.642722 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 293/571] 10.222.0.104 () {58 vars in 1444 bytes} [Tue Aug 9 16:27:15 2022] PUT /identity/v3/projects/63557f0ff1ce4ae49899b4627bafd94e/users/717261252a9a44de8a71c10fda7082b0/roles/aa624ab843384e48873a8d5a72422836 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 16:27:15.643886 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97654748-6f51-4558-8613-3b5958ef0bd1 None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:15.684183 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:15.698360 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:15.750147 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f0f6d3-c146-4b78-b936-2326364b16f0 None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:15.805252 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97654748-6f51-4558-8613-3b5958ef0bd1 None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:15.809113 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c719c00f-35e1-42ca-9466-bd2851ce4603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:15.810373 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c719c00f-35e1-42ca-9466-bd2851ce4603 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:15.810373 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c719c00f-35e1-42ca-9466-bd2851ce4603 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:15.810576 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c719c00f-35e1-42ca-9466-bd2851ce4603 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:15.822933 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c719c00f-35e1-42ca-9466-bd2851ce4603 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:15.824723 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c719c00f-35e1-42ca-9466-bd2851ce4603 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:15.842711 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application [None req-c719c00f-35e1-42ca-9466-bd2851ce4603 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 16:27:15.842711 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:27:15.842711 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:27:15.842711 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:27:15.842711 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:27:15.842711 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:27:15.842711 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:27:15.842711 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:27:15.842711 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:27:15.842711 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:27:15.842711 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:27:15.842711 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:27:15.842711 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 16:27:15.842711 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 16:27:15.842711 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 16:27:15.842711 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 16:27:15.843762 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:27:15.843762 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:27:15.843762 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:27:15.843762 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:27:15.843762 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:27:15.843762 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:27:15.843762 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:27:15.843762 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application with Lock( Aug 09 16:27:15.843762 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:27:15.843762 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:27:15.843762 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:27:15.843762 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:27:15.843762 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:27:15.843762 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:27:15.843762 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:27:15.843762 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:27:15.843762 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 16:27:15.844989 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 16:27:15.844989 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 16:27:15.844989 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Aug 09 16:27:15.844989 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 279/572] 10.222.0.104 () {56 vars in 1113 bytes} [Tue Aug 9 16:27:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 16:27:15.849202 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c719c00f-35e1-42ca-9466-bd2851ce4603 None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:15.860296 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0b5e2a-ed03-4dcd-91e8-0bc8878ba3f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:15.861196 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0b5e2a-ed03-4dcd-91e8-0bc8878ba3f6 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:15.861635 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0b5e2a-ed03-4dcd-91e8-0bc8878ba3f6 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:15.862106 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0b5e2a-ed03-4dcd-91e8-0bc8878ba3f6 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:15.870914 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0b5e2a-ed03-4dcd-91e8-0bc8878ba3f6 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:15.872600 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0b5e2a-ed03-4dcd-91e8-0bc8878ba3f6 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:15.885693 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application [None req-9c0b5e2a-ed03-4dcd-91e8-0bc8878ba3f6 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 09 16:27:15.885693 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:27:15.885693 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:27:15.885693 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:27:15.885693 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:27:15.885693 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:27:15.885693 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:27:15.885693 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:27:15.885693 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:27:15.885693 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:27:15.885693 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:27:15.885693 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:27:15.885693 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 16:27:15.885693 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 16:27:15.885693 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 16:27:15.885693 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 16:27:15.886945 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:27:15.886945 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:27:15.886945 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 16:27:15.886945 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 16:27:15.886945 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 16:27:15.886945 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 16:27:15.886945 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:27:15.886945 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:27:15.886945 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:27:15.886945 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:27:15.886945 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:27:15.886945 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application with Lock( Aug 09 16:27:15.886945 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:27:15.886945 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:27:15.886945 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:27:15.886945 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:27:15.886945 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:27:15.886945 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:27:15.888082 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:27:15.888082 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:27:15.888082 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 16:27:15.888082 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 16:27:15.888082 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 16:27:15.888082 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 16:27:15.888082 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 16:27:15.888082 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 16:27:15.888082 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 09 16:27:15.888082 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Aug 09 16:27:15.889989 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 294/573] 10.222.0.104 () {56 vars in 1107 bytes} [Tue Aug 9 16:27:15 2022] GET /identity/v3/users/neutron => generated 85 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 16:27:15.892720 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0b5e2a-ed03-4dcd-91e8-0bc8878ba3f6 None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:15.984615 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c719c00f-35e1-42ca-9466-bd2851ce4603 None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:15.998584 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:16.004658 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:16.023927 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0b5e2a-ed03-4dcd-91e8-0bc8878ba3f6 None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:16.028497 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b64f118-dee1-4926-9599-15710be361ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:16.029413 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b64f118-dee1-4926-9599-15710be361ae None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:16.029937 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b64f118-dee1-4926-9599-15710be361ae None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:16.030469 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b64f118-dee1-4926-9599-15710be361ae None admin] PATH_INFO: `/v3/domains` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:16.031313 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b64f118-dee1-4926-9599-15710be361ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=87276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:27:16.031819 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b64f118-dee1-4926-9599-15710be361ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:16.033510 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b64f118-dee1-4926-9599-15710be361ae None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:16.052750 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 280/574] 10.222.0.104 () {56 vars in 1114 bytes} [Tue Aug 9 16:27:15 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 16:27:16.054011 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b64f118-dee1-4926-9599-15710be361ae None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:16.074855 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e68f25-7e91-424e-b497-efecdf3810ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:16.075856 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e68f25-7e91-424e-b497-efecdf3810ff None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:16.076425 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e68f25-7e91-424e-b497-efecdf3810ff None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:16.076919 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e68f25-7e91-424e-b497-efecdf3810ff None admin] PATH_INFO: `/v3/users` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:16.077978 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e68f25-7e91-424e-b497-efecdf3810ff None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=87275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:27:16.078483 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e68f25-7e91-424e-b497-efecdf3810ff None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:16.080353 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e68f25-7e91-424e-b497-efecdf3810ff None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:16.100615 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 295/575] 10.222.0.104 () {56 vars in 1144 bytes} [Tue Aug 9 16:27:15 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 376 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:27:16.106668 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e68f25-7e91-424e-b497-efecdf3810ff None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:16.171390 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b64f118-dee1-4926-9599-15710be361ae None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:16.208546 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac407225-1608-4dc9-a240-25278aa87946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:16.209393 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac407225-1608-4dc9-a240-25278aa87946 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:16.209674 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac407225-1608-4dc9-a240-25278aa87946 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:16.209974 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac407225-1608-4dc9-a240-25278aa87946 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:16.217173 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e68f25-7e91-424e-b497-efecdf3810ff None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:16.217359 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac407225-1608-4dc9-a240-25278aa87946 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:16.218922 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac407225-1608-4dc9-a240-25278aa87946 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:16.230499 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application [None req-ac407225-1608-4dc9-a240-25278aa87946 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 16:27:16.230499 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:27:16.230499 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:27:16.230499 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:27:16.230499 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:27:16.230499 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:27:16.230499 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:27:16.230499 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:27:16.230499 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:27:16.230499 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:27:16.230499 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:27:16.230499 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:27:16.230499 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 16:27:16.230499 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 16:27:16.230499 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 16:27:16.231446 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 16:27:16.231446 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:27:16.231446 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:27:16.231446 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:27:16.231446 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:27:16.231446 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:27:16.231446 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:27:16.231446 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:27:16.231446 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application with Lock( Aug 09 16:27:16.231446 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:27:16.231446 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:27:16.231446 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:27:16.231446 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:27:16.231446 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:27:16.231446 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:27:16.231446 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:27:16.231446 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:27:16.232618 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 16:27:16.232618 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 16:27:16.232618 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 16:27:16.232618 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 16:27:16.232618 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 16:27:16.232618 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 16:27:16.232618 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 16:27:16.232618 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Aug 09 16:27:16.232618 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 281/576] 10.222.0.104 () {56 vars in 1116 bytes} [Tue Aug 9 16:27:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 16:27:16.237460 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac407225-1608-4dc9-a240-25278aa87946 None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:16.257249 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f88908d-3373-44f5-9d1b-cd66b1a284e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:16.258278 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f88908d-3373-44f5-9d1b-cd66b1a284e4 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:16.258721 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f88908d-3373-44f5-9d1b-cd66b1a284e4 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:16.259140 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f88908d-3373-44f5-9d1b-cd66b1a284e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:16.271062 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f88908d-3373-44f5-9d1b-cd66b1a284e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:16.272845 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f88908d-3373-44f5-9d1b-cd66b1a284e4 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:16.274901 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:16.278658 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:16.291597 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application [None req-8f88908d-3373-44f5-9d1b-cd66b1a284e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 16:27:16.291597 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:27:16.291597 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:27:16.291597 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:27:16.291597 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:27:16.291597 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:27:16.291597 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:27:16.291597 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:27:16.291597 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:27:16.291597 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:27:16.291597 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:27:16.291597 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:27:16.291597 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 16:27:16.291597 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 16:27:16.291597 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 16:27:16.291597 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 16:27:16.292618 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:27:16.292618 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:27:16.292618 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:27:16.292618 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:27:16.292618 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:27:16.292618 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:27:16.292618 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:27:16.292618 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application with Lock( Aug 09 16:27:16.292618 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:27:16.292618 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:27:16.292618 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:27:16.292618 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:27:16.292618 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:27:16.292618 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:27:16.292618 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:27:16.292618 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:27:16.292618 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 16:27:16.293483 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 16:27:16.293483 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 16:27:16.293483 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Aug 09 16:27:16.299840 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 296/577] 10.222.0.104 () {56 vars in 1113 bytes} [Tue Aug 9 16:27:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 16:27:16.301453 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f88908d-3373-44f5-9d1b-cd66b1a284e4 None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:16.353323 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac407225-1608-4dc9-a240-25278aa87946 None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:16.393945 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83dc437-1997-4d26-9331-acfedd906f06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:16.394713 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83dc437-1997-4d26-9331-acfedd906f06 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:16.395180 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83dc437-1997-4d26-9331-acfedd906f06 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:16.395548 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83dc437-1997-4d26-9331-acfedd906f06 None admin] PATH_INFO: `/v3/projects` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:16.396441 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83dc437-1997-4d26-9331-acfedd906f06 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:27:16.396811 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83dc437-1997-4d26-9331-acfedd906f06 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:16.398406 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83dc437-1997-4d26-9331-acfedd906f06 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:16.411955 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 282/578] 10.222.0.104 () {56 vars in 1153 bytes} [Tue Aug 9 16:27:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:27:16.413875 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f88908d-3373-44f5-9d1b-cd66b1a284e4 None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:16.417296 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83dc437-1997-4d26-9331-acfedd906f06 None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:16.450456 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f25045b-0ffe-4ad7-9137-0d417f3e5a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:16.451355 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f25045b-0ffe-4ad7-9137-0d417f3e5a18 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:16.451793 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f25045b-0ffe-4ad7-9137-0d417f3e5a18 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:16.452214 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f25045b-0ffe-4ad7-9137-0d417f3e5a18 None admin] PATH_INFO: `/v3/domains` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:16.453008 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f25045b-0ffe-4ad7-9137-0d417f3e5a18 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:27:16.453457 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f25045b-0ffe-4ad7-9137-0d417f3e5a18 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:16.455008 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f25045b-0ffe-4ad7-9137-0d417f3e5a18 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:16.473417 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 297/579] 10.222.0.104 () {56 vars in 1114 bytes} [Tue Aug 9 16:27:16 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 16:27:16.475152 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f25045b-0ffe-4ad7-9137-0d417f3e5a18 None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:16.543563 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:16.552768 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83dc437-1997-4d26-9331-acfedd906f06 None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:16.564637 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:16.609519 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdb9d92-77ca-4eb4-be32-4633f53ab9f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:16.610607 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdb9d92-77ca-4eb4-be32-4633f53ab9f3 None admin] REQUEST_METHOD: `PUT` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:16.611112 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdb9d92-77ca-4eb4-be32-4633f53ab9f3 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:16.611804 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdb9d92-77ca-4eb4-be32-4633f53ab9f3 None admin] PATH_INFO: `/v3/projects/63557f0ff1ce4ae49899b4627bafd94e/users/e914013dfd8b448e8cdbd6b8399cfd0c/roles/aa624ab843384e48873a8d5a72422836` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:16.629327 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdb9d92-77ca-4eb4-be32-4633f53ab9f3 None admin] RBAC: Authorizing `identity:create_grant(project_id=63557f0ff1ce4ae49899b4627bafd94e, user_id=e914013dfd8b448e8cdbd6b8399cfd0c, role_id=aa624ab843384e48873a8d5a72422836)` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:16.632052 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdb9d92-77ca-4eb4-be32-4633f53ab9f3 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:16.644416 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f25045b-0ffe-4ad7-9137-0d417f3e5a18 None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:16.658951 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 283/580] 10.222.0.104 () {58 vars in 1444 bytes} [Tue Aug 9 16:27:16 2022] PUT /identity/v3/projects/63557f0ff1ce4ae49899b4627bafd94e/users/e914013dfd8b448e8cdbd6b8399cfd0c/roles/aa624ab843384e48873a8d5a72422836 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 16:27:16.693868 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717c3c83-3556-402c-9b5b-88b942634d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:16.695043 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717c3c83-3556-402c-9b5b-88b942634d22 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:16.695530 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717c3c83-3556-402c-9b5b-88b942634d22 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:16.696019 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717c3c83-3556-402c-9b5b-88b942634d22 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:16.704518 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717c3c83-3556-402c-9b5b-88b942634d22 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:16.706204 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717c3c83-3556-402c-9b5b-88b942634d22 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:16.719829 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application [None req-717c3c83-3556-402c-9b5b-88b942634d22 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 16:27:16.719829 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:27:16.719829 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:27:16.719829 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:27:16.719829 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:27:16.719829 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:27:16.719829 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:27:16.719829 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:27:16.719829 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:27:16.719829 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:27:16.719829 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:27:16.719829 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:27:16.719829 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 16:27:16.719829 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 16:27:16.719829 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 16:27:16.720796 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 16:27:16.720796 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:27:16.720796 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:27:16.720796 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:27:16.720796 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:27:16.720796 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:27:16.720796 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:27:16.720796 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:27:16.720796 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application with Lock( Aug 09 16:27:16.720796 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:27:16.720796 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:27:16.720796 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:27:16.720796 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:27:16.720796 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:27:16.720796 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:27:16.720796 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:27:16.720796 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:27:16.721694 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 16:27:16.721694 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 16:27:16.721694 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 16:27:16.721694 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 16:27:16.721694 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 16:27:16.721694 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 16:27:16.721694 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 16:27:16.721694 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Aug 09 16:27:16.724251 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 298/581] 10.222.0.104 () {56 vars in 1116 bytes} [Tue Aug 9 16:27:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 16:27:16.731047 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdb9d92-77ca-4eb4-be32-4633f53ab9f3 None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:16.907011 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdb9d92-77ca-4eb4-be32-4633f53ab9f3 None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:16.965927 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0751e2bd-b954-4823-896f-7d129ad91e86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:16.965927 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0751e2bd-b954-4823-896f-7d129ad91e86 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:16.965927 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0751e2bd-b954-4823-896f-7d129ad91e86 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:16.965927 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0751e2bd-b954-4823-896f-7d129ad91e86 None admin] PATH_INFO: `/v3/projects` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:16.966351 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0751e2bd-b954-4823-896f-7d129ad91e86 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:27:16.966351 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0751e2bd-b954-4823-896f-7d129ad91e86 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:16.966698 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0751e2bd-b954-4823-896f-7d129ad91e86 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:16.984749 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 284/582] 10.222.0.104 () {56 vars in 1153 bytes} [Tue Aug 9 16:27:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:27:16.986507 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717c3c83-3556-402c-9b5b-88b942634d22 None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:17.125216 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717c3c83-3556-402c-9b5b-88b942634d22 None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:17.140784 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:17.162989 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d990d6cd-ca83-42e7-9276-80e9884dd611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:17.163905 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d990d6cd-ca83-42e7-9276-80e9884dd611 None admin] REQUEST_METHOD: `PUT` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:17.164325 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d990d6cd-ca83-42e7-9276-80e9884dd611 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:17.164748 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d990d6cd-ca83-42e7-9276-80e9884dd611 None admin] PATH_INFO: `/v3/projects/63557f0ff1ce4ae49899b4627bafd94e/users/da49ba8d1a21406eac55503b42fea65b/roles/aa624ab843384e48873a8d5a72422836` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:17.180051 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d990d6cd-ca83-42e7-9276-80e9884dd611 None admin] RBAC: Authorizing `identity:create_grant(project_id=63557f0ff1ce4ae49899b4627bafd94e, user_id=da49ba8d1a21406eac55503b42fea65b, role_id=aa624ab843384e48873a8d5a72422836)` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:17.182107 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d990d6cd-ca83-42e7-9276-80e9884dd611 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:17.197240 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 299/583] 10.222.0.104 () {58 vars in 1444 bytes} [Tue Aug 9 16:27:16 2022] PUT /identity/v3/projects/63557f0ff1ce4ae49899b4627bafd94e/users/da49ba8d1a21406eac55503b42fea65b/roles/aa624ab843384e48873a8d5a72422836 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 16:27:17.718905 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d912765-bfb4-473c-b861-5705eefad093 None None] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:17.719424 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d912765-bfb4-473c-b861-5705eefad093 None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:17.719424 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d912765-bfb4-473c-b861-5705eefad093 None None] PATH_INFO: `/` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:17.720996 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 285/584] 10.222.0.104 () {54 vars in 932 bytes} [Tue Aug 9 16:27:17 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:27:17.726486 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582a0c40-f990-4e32-a870-e96d6fa3f5f4 None None] REQUEST_METHOD: `POST` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:17.726875 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582a0c40-f990-4e32-a870-e96d6fa3f5f4 None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:17.727056 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582a0c40-f990-4e32-a870-e96d6fa3f5f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:17.747684 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.auth.core [None req-582a0c40-f990-4e32-a870-e96d6fa3f5f4 None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:27:17.748939 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.fernet_utils [None req-582a0c40-f990-4e32-a870-e96d6fa3f5f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:27:17.831735 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 300/585] 10.222.0.104 () {58 vars in 1029 bytes} [Tue Aug 9 16:27:17 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 16:27:17.856841 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d912765-bfb4-473c-b861-5705eefad093 None None] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:17.866499 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:17.976334 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d912765-bfb4-473c-b861-5705eefad093 None None] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:18.013617 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eadf7f2-bf7d-4185-b99e-7017cf13ef3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:18.014412 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eadf7f2-bf7d-4185-b99e-7017cf13ef3d None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:18.014588 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eadf7f2-bf7d-4185-b99e-7017cf13ef3d None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:18.014821 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eadf7f2-bf7d-4185-b99e-7017cf13ef3d None admin] PATH_INFO: `/v3/roles/service` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:18.025276 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eadf7f2-bf7d-4185-b99e-7017cf13ef3d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 16:27:18.031788 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application [None req-2eadf7f2-bf7d-4185-b99e-7017cf13ef3d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 16:27:18.031788 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:27:18.031788 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:27:18.031788 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:27:18.031788 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:27:18.031788 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:27:18.031788 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:27:18.031788 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:27:18.031788 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:27:18.031788 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:27:18.031788 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:27:18.031788 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:27:18.031788 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 16:27:18.031788 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 16:27:18.031788 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 16:27:18.031788 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 16:27:18.032700 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 16:27:18.032700 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 16:27:18.032700 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 16:27:18.032700 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 16:27:18.032700 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:27:18.032700 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:27:18.032700 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:27:18.032700 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:27:18.032700 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:27:18.032700 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:27:18.032700 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:27:18.032700 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application with Lock( Aug 09 16:27:18.032700 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:27:18.032700 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:27:18.032700 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:27:18.032700 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:27:18.033529 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:27:18.033529 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:27:18.033529 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:27:18.033529 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:27:18.033529 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 16:27:18.033529 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 16:27:18.033529 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 16:27:18.033529 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 16:27:18.033529 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 16:27:18.033529 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 16:27:18.033529 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 16:27:18.033529 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Aug 09 16:27:18.033529 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 286/586] 10.222.0.104 () {56 vars in 1107 bytes} [Tue Aug 9 16:27:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 16:27:18.038656 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582a0c40-f990-4e32-a870-e96d6fa3f5f4 None None] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:18.148486 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:18.151781 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08017744-f042-444a-a69f-e12cfb1ef5de None None] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:18.153476 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08017744-f042-444a-a69f-e12cfb1ef5de None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:18.154024 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08017744-f042-444a-a69f-e12cfb1ef5de None None] PATH_INFO: `/` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:18.156069 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582a0c40-f990-4e32-a870-e96d6fa3f5f4 None None] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:18.156282 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 287/587] 10.222.0.104 () {54 vars in 932 bytes} [Tue Aug 9 16:27:18 2022] GET /identity => generated 271 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 09 16:27:18.162046 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6e630b-baf9-4c60-8805-4315026cc4a6 None None] REQUEST_METHOD: `POST` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:18.162563 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6e630b-baf9-4c60-8805-4315026cc4a6 None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:18.163005 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6e630b-baf9-4c60-8805-4315026cc4a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:18.186708 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.auth.core [None req-1b6e630b-baf9-4c60-8805-4315026cc4a6 None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:27:18.188271 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.fernet_utils [None req-1b6e630b-baf9-4c60-8805-4315026cc4a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:27:18.192123 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5167b0-e5f1-4c18-afce-93cee78dd1f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:18.192815 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5167b0-e5f1-4c18-afce-93cee78dd1f7 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:18.193157 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5167b0-e5f1-4c18-afce-93cee78dd1f7 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:18.193490 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5167b0-e5f1-4c18-afce-93cee78dd1f7 None admin] PATH_INFO: `/v3/roles` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:18.194238 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5167b0-e5f1-4c18-afce-93cee78dd1f7 None admin] RBAC: Adding query filter params (name=service) {{(pid=87275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:27:18.194602 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5167b0-e5f1-4c18-afce-93cee78dd1f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:18.196037 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5167b0-e5f1-4c18-afce-93cee78dd1f7 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:18.209931 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 301/588] 10.222.0.104 () {56 vars in 1108 bytes} [Tue Aug 9 16:27:18 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:27:18.211837 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5167b0-e5f1-4c18-afce-93cee78dd1f7 None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:18.267030 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:18.286087 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 288/589] 10.222.0.104 () {58 vars in 1029 bytes} [Tue Aug 9 16:27:18 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 16:27:18.315000 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6e630b-baf9-4c60-8805-4315026cc4a6 None None] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:18.325617 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5167b0-e5f1-4c18-afce-93cee78dd1f7 None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:18.361496 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bac32e-6468-4539-bf07-83c309a12303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:18.362166 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bac32e-6468-4539-bf07-83c309a12303 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:18.362441 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bac32e-6468-4539-bf07-83c309a12303 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:18.362707 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bac32e-6468-4539-bf07-83c309a12303 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:18.374368 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bac32e-6468-4539-bf07-83c309a12303 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:18.375825 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bac32e-6468-4539-bf07-83c309a12303 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:18.391270 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application [None req-13bac32e-6468-4539-bf07-83c309a12303 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 16:27:18.391270 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:27:18.391270 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:27:18.391270 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:27:18.391270 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:27:18.391270 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:27:18.391270 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:27:18.391270 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:27:18.391270 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:27:18.391270 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:27:18.391270 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:27:18.391270 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:27:18.391270 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 16:27:18.391270 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 16:27:18.391270 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 16:27:18.391270 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 16:27:18.392279 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:27:18.392279 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:27:18.392279 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:27:18.392279 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:27:18.392279 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:27:18.392279 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:27:18.392279 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:27:18.392279 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application with Lock( Aug 09 16:27:18.392279 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:27:18.392279 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:27:18.392279 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:27:18.392279 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:27:18.392279 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:27:18.392279 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:27:18.392279 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:27:18.392279 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:27:18.392279 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 16:27:18.393180 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 16:27:18.393180 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 16:27:18.393180 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Aug 09 16:27:18.396967 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 302/590] 10.222.0.104 () {56 vars in 1113 bytes} [Tue Aug 9 16:27:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 16:27:18.399428 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bac32e-6468-4539-bf07-83c309a12303 None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:18.415608 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:18.445352 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6e630b-baf9-4c60-8805-4315026cc4a6 None None] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:18.482098 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082fc065-10b8-4f54-9e0e-5d589c8b457c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:18.483035 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082fc065-10b8-4f54-9e0e-5d589c8b457c None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:18.483317 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082fc065-10b8-4f54-9e0e-5d589c8b457c None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:18.483588 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082fc065-10b8-4f54-9e0e-5d589c8b457c None admin] PATH_INFO: `/v3/roles/service` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:18.494029 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082fc065-10b8-4f54-9e0e-5d589c8b457c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 16:27:18.499430 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application [None req-082fc065-10b8-4f54-9e0e-5d589c8b457c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 16:27:18.499430 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:27:18.499430 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:27:18.499430 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:27:18.499430 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:27:18.499430 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:27:18.499430 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:27:18.499430 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:27:18.499430 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:27:18.499430 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:27:18.499430 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:27:18.499430 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:27:18.499430 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 16:27:18.499430 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 16:27:18.499430 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 16:27:18.499430 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 16:27:18.500342 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 16:27:18.500342 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 16:27:18.500342 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 16:27:18.500342 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 16:27:18.500342 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:27:18.500342 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:27:18.500342 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:27:18.500342 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:27:18.500342 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:27:18.500342 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:27:18.500342 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:27:18.500342 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application with Lock( Aug 09 16:27:18.500342 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:27:18.500342 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:27:18.500342 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:27:18.500342 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:27:18.501170 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:27:18.501170 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:27:18.501170 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:27:18.501170 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:27:18.501170 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 16:27:18.501170 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 16:27:18.501170 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 16:27:18.501170 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 16:27:18.501170 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 16:27:18.501170 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 16:27:18.501170 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 16:27:18.501170 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Aug 09 16:27:18.501170 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 289/591] 10.222.0.104 () {56 vars in 1107 bytes} [Tue Aug 9 16:27:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 16:27:18.507156 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082fc065-10b8-4f54-9e0e-5d589c8b457c None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:18.531519 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bac32e-6468-4539-bf07-83c309a12303 None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:18.567216 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:18.567406 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61efa898-b3a5-4df2-8e78-62cec4711b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:18.568259 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61efa898-b3a5-4df2-8e78-62cec4711b8c None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:18.568369 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61efa898-b3a5-4df2-8e78-62cec4711b8c None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:18.568944 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61efa898-b3a5-4df2-8e78-62cec4711b8c None admin] PATH_INFO: `/v3/domains` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:18.569380 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61efa898-b3a5-4df2-8e78-62cec4711b8c None admin] RBAC: Adding query filter params (name=Default) {{(pid=87275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:27:18.569750 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61efa898-b3a5-4df2-8e78-62cec4711b8c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:18.571885 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61efa898-b3a5-4df2-8e78-62cec4711b8c None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:18.589945 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 303/592] 10.222.0.104 () {56 vars in 1114 bytes} [Tue Aug 9 16:27:18 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:27:18.593748 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61efa898-b3a5-4df2-8e78-62cec4711b8c None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:18.626156 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082fc065-10b8-4f54-9e0e-5d589c8b457c None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:18.670441 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5c8099-4230-4deb-a3d9-d2edd3bd3432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:18.671048 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5c8099-4230-4deb-a3d9-d2edd3bd3432 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:18.671328 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5c8099-4230-4deb-a3d9-d2edd3bd3432 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:18.671907 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5c8099-4230-4deb-a3d9-d2edd3bd3432 None admin] PATH_INFO: `/v3/roles` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:18.672584 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5c8099-4230-4deb-a3d9-d2edd3bd3432 None admin] RBAC: Adding query filter params (name=service) {{(pid=87276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:27:18.672887 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5c8099-4230-4deb-a3d9-d2edd3bd3432 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:18.674855 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5c8099-4230-4deb-a3d9-d2edd3bd3432 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:18.685544 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:18.685830 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 290/593] 10.222.0.104 () {56 vars in 1108 bytes} [Tue Aug 9 16:27:18 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 16:27:18.696687 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5c8099-4230-4deb-a3d9-d2edd3bd3432 None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:18.742243 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61efa898-b3a5-4df2-8e78-62cec4711b8c None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:18.783306 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742acaf2-dc41-4c07-abe5-88a551066597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:18.784054 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742acaf2-dc41-4c07-abe5-88a551066597 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:18.784376 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742acaf2-dc41-4c07-abe5-88a551066597 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:18.784745 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742acaf2-dc41-4c07-abe5-88a551066597 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:18.793334 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742acaf2-dc41-4c07-abe5-88a551066597 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:18.794890 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742acaf2-dc41-4c07-abe5-88a551066597 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:18.814394 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application [None req-742acaf2-dc41-4c07-abe5-88a551066597 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 09 16:27:18.814394 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:27:18.814394 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:27:18.814394 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:27:18.814394 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:27:18.814394 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:27:18.814394 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:27:18.814394 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:27:18.814394 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:27:18.814394 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:27:18.814394 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:27:18.814394 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:27:18.814394 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 16:27:18.814394 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 16:27:18.814394 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 16:27:18.814394 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 16:27:18.815562 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:27:18.815562 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:27:18.815562 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 16:27:18.815562 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 16:27:18.815562 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 16:27:18.815562 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 16:27:18.815562 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:27:18.815562 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:27:18.815562 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:27:18.815562 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:27:18.815562 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:27:18.815562 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application with Lock( Aug 09 16:27:18.815562 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:27:18.815562 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:27:18.815562 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:27:18.815562 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:27:18.815562 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:27:18.815562 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:27:18.816889 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:27:18.816889 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:27:18.816889 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 16:27:18.816889 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 16:27:18.816889 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 16:27:18.816889 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 16:27:18.816889 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 16:27:18.816889 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 16:27:18.816889 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 09 16:27:18.816889 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Aug 09 16:27:18.819459 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 304/594] 10.222.0.104 () {56 vars in 1098 bytes} [Tue Aug 9 16:27:18 2022] GET /identity/v3/users/nova => generated 82 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 16:27:18.829923 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742acaf2-dc41-4c07-abe5-88a551066597 None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:18.833725 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5c8099-4230-4deb-a3d9-d2edd3bd3432 None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:18.852640 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:18.872289 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d74fa4-6179-4b6f-a3ac-1cdce4f6296e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:18.873065 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d74fa4-6179-4b6f-a3ac-1cdce4f6296e None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:18.873445 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d74fa4-6179-4b6f-a3ac-1cdce4f6296e None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:18.873835 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d74fa4-6179-4b6f-a3ac-1cdce4f6296e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:18.885134 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d74fa4-6179-4b6f-a3ac-1cdce4f6296e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:18.886768 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d74fa4-6179-4b6f-a3ac-1cdce4f6296e None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:18.902297 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application [None req-96d74fa4-6179-4b6f-a3ac-1cdce4f6296e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 16:27:18.902297 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:27:18.902297 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:27:18.902297 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:27:18.902297 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:27:18.902297 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:27:18.902297 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:27:18.902297 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:27:18.902297 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:27:18.902297 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:27:18.902297 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:27:18.902297 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:27:18.902297 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 16:27:18.902297 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 16:27:18.902297 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 16:27:18.902297 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 16:27:18.903472 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:27:18.903472 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:27:18.903472 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:27:18.903472 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:27:18.903472 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:27:18.903472 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:27:18.903472 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:27:18.903472 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application with Lock( Aug 09 16:27:18.903472 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:27:18.903472 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:27:18.903472 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:27:18.903472 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:27:18.903472 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:27:18.903472 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:27:18.903472 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:27:18.903472 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:27:18.903472 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 16:27:18.904554 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 16:27:18.904554 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 16:27:18.904554 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Aug 09 16:27:18.904554 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 291/595] 10.222.0.104 () {56 vars in 1113 bytes} [Tue Aug 9 16:27:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 16:27:18.911578 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d74fa4-6179-4b6f-a3ac-1cdce4f6296e None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:18.954781 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742acaf2-dc41-4c07-abe5-88a551066597 None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:18.987457 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:18.997879 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e3792f-7059-47a9-9316-37691111228a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:18.998813 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e3792f-7059-47a9-9316-37691111228a None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:18.999289 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e3792f-7059-47a9-9316-37691111228a None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:18.999754 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e3792f-7059-47a9-9316-37691111228a None admin] PATH_INFO: `/v3/users` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:19.000780 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e3792f-7059-47a9-9316-37691111228a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:27:19.001293 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e3792f-7059-47a9-9316-37691111228a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:19.003121 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e3792f-7059-47a9-9316-37691111228a None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:19.024523 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 305/596] 10.222.0.104 () {56 vars in 1138 bytes} [Tue Aug 9 16:27:18 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:27:19.032403 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d74fa4-6179-4b6f-a3ac-1cdce4f6296e None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:19.035644 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e3792f-7059-47a9-9316-37691111228a None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:19.073571 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbf1bc4-bb7c-4862-868c-78a61a182335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:19.074586 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbf1bc4-bb7c-4862-868c-78a61a182335 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:19.075150 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbf1bc4-bb7c-4862-868c-78a61a182335 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:19.075702 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbf1bc4-bb7c-4862-868c-78a61a182335 None admin] PATH_INFO: `/v3/domains` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:19.076561 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbf1bc4-bb7c-4862-868c-78a61a182335 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:27:19.077125 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbf1bc4-bb7c-4862-868c-78a61a182335 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:19.078820 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbf1bc4-bb7c-4862-868c-78a61a182335 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:19.094473 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 292/597] 10.222.0.104 () {56 vars in 1114 bytes} [Tue Aug 9 16:27:18 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 16:27:19.099990 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbf1bc4-bb7c-4862-868c-78a61a182335 None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:19.142632 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:19.172563 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e3792f-7059-47a9-9316-37691111228a None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:19.216061 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135aaab6-e4ee-4915-bdea-09cd75e4c2da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:19.216666 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135aaab6-e4ee-4915-bdea-09cd75e4c2da None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:19.216937 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135aaab6-e4ee-4915-bdea-09cd75e4c2da None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:19.217203 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135aaab6-e4ee-4915-bdea-09cd75e4c2da None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:19.242727 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbf1bc4-bb7c-4862-868c-78a61a182335 None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:19.284023 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43294417-5395-4b82-ac7e-2632fc3d302e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:19.284400 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43294417-5395-4b82-ac7e-2632fc3d302e None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:19.284660 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43294417-5395-4b82-ac7e-2632fc3d302e None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:19.284928 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43294417-5395-4b82-ac7e-2632fc3d302e None admin] PATH_INFO: `/v3/users/glance` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:19.289150 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:19.295204 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43294417-5395-4b82-ac7e-2632fc3d302e None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:19.297289 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43294417-5395-4b82-ac7e-2632fc3d302e None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:19.309886 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135aaab6-e4ee-4915-bdea-09cd75e4c2da None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:19.311742 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135aaab6-e4ee-4915-bdea-09cd75e4c2da None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:19.313226 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application [None req-43294417-5395-4b82-ac7e-2632fc3d302e None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 09 16:27:19.313226 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:27:19.313226 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:27:19.313226 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:27:19.313226 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:27:19.313226 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:27:19.313226 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:27:19.313226 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:27:19.313226 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:27:19.313226 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:27:19.313226 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:27:19.313226 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:27:19.313226 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 16:27:19.313226 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 16:27:19.313226 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 16:27:19.313226 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 16:27:19.314223 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:27:19.314223 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:27:19.314223 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 16:27:19.314223 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 16:27:19.314223 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 16:27:19.314223 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 16:27:19.314223 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:27:19.314223 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:27:19.314223 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:27:19.314223 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:27:19.314223 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:27:19.314223 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application with Lock( Aug 09 16:27:19.314223 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:27:19.314223 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:27:19.314223 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:27:19.314223 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:27:19.314223 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:27:19.314223 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:27:19.315164 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:27:19.315164 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:27:19.315164 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 16:27:19.315164 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 16:27:19.315164 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 16:27:19.315164 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 16:27:19.315164 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 16:27:19.315164 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 16:27:19.315164 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 09 16:27:19.315164 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Aug 09 16:27:19.315164 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 293/598] 10.222.0.104 () {56 vars in 1104 bytes} [Tue Aug 9 16:27:19 2022] GET /identity/v3/users/glance => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 16:27:19.322076 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43294417-5395-4b82-ac7e-2632fc3d302e None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:19.435510 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:19.445652 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 306/599] 10.222.0.104 () {58 vars in 1287 bytes} [Tue Aug 9 16:27:19 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 16:27:19.447146 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef45312-b521-4976-b86a-a3a33f7a081f None None] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:19.447437 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef45312-b521-4976-b86a-a3a33f7a081f None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:19.447712 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef45312-b521-4976-b86a-a3a33f7a081f None None] PATH_INFO: `/` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:19.449613 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 307/600] 10.222.0.104 () {54 vars in 932 bytes} [Tue Aug 9 16:27:19 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:27:19.452045 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43294417-5395-4b82-ac7e-2632fc3d302e None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:19.454148 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef45312-b521-4976-b86a-a3a33f7a081f None None] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:19.490744 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e515feb-4eeb-4576-8c8c-95aad57e925f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:19.491348 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e515feb-4eeb-4576-8c8c-95aad57e925f None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:19.491624 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e515feb-4eeb-4576-8c8c-95aad57e925f None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:19.491889 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e515feb-4eeb-4576-8c8c-95aad57e925f None admin] PATH_INFO: `/v3/users` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:19.492609 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e515feb-4eeb-4576-8c8c-95aad57e925f None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=87276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:27:19.492918 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e515feb-4eeb-4576-8c8c-95aad57e925f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:19.494438 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e515feb-4eeb-4576-8c8c-95aad57e925f None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:19.518454 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 294/601] 10.222.0.104 () {56 vars in 1142 bytes} [Tue Aug 9 16:27:19 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 374 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 16:27:19.518454 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e6f80a-5722-4d04-bdac-a52bc4884f63 None None] REQUEST_METHOD: `POST` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:19.518454 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e6f80a-5722-4d04-bdac-a52bc4884f63 None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:19.518454 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e6f80a-5722-4d04-bdac-a52bc4884f63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:19.533524 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.auth.core [None req-20e6f80a-5722-4d04-bdac-a52bc4884f63 None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:27:19.534741 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.fernet_utils [None req-20e6f80a-5722-4d04-bdac-a52bc4884f63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:27:19.549855 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:19.567245 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef45312-b521-4976-b86a-a3a33f7a081f None None] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:19.600884 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba6b1cc-1971-4e40-ae3e-78f825db7680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:19.601167 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 295/602] 10.222.0.104 () {58 vars in 1029 bytes} [Tue Aug 9 16:27:19 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 16:27:19.602037 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e6f80a-5722-4d04-bdac-a52bc4884f63 None None] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:19.602569 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba6b1cc-1971-4e40-ae3e-78f825db7680 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:19.602927 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba6b1cc-1971-4e40-ae3e-78f825db7680 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:19.603273 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba6b1cc-1971-4e40-ae3e-78f825db7680 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:19.615108 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba6b1cc-1971-4e40-ae3e-78f825db7680 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:19.616569 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba6b1cc-1971-4e40-ae3e-78f825db7680 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:19.631857 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application [None req-fba6b1cc-1971-4e40-ae3e-78f825db7680 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 16:27:19.631857 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:27:19.631857 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:27:19.631857 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:27:19.631857 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:27:19.631857 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:27:19.631857 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:27:19.631857 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:27:19.631857 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:27:19.631857 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:27:19.631857 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:27:19.631857 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:27:19.631857 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 16:27:19.631857 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 16:27:19.631857 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 16:27:19.631857 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 16:27:19.632919 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:27:19.632919 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:27:19.632919 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:27:19.632919 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:27:19.632919 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:27:19.632919 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:27:19.632919 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:27:19.632919 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application with Lock( Aug 09 16:27:19.632919 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:27:19.632919 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:27:19.632919 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:27:19.632919 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:27:19.632919 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:27:19.632919 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:27:19.632919 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:27:19.632919 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:27:19.632919 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 16:27:19.633813 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 16:27:19.633813 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 16:27:19.633813 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Aug 09 16:27:19.633813 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 308/603] 10.222.0.104 () {56 vars in 1113 bytes} [Tue Aug 9 16:27:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 16:27:19.634241 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c2c16b-04fc-4973-b103-1408e986178d None None] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:19.634459 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c2c16b-04fc-4973-b103-1408e986178d None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:19.634669 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c2c16b-04fc-4973-b103-1408e986178d None None] PATH_INFO: `/` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:19.636436 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 309/604] 10.222.0.104 () {54 vars in 932 bytes} [Tue Aug 9 16:27:19 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:27:19.637093 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c2c16b-04fc-4973-b103-1408e986178d None None] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:19.687283 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:19.709076 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e6f80a-5722-4d04-bdac-a52bc4884f63 None None] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:19.746639 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c2c16b-04fc-4973-b103-1408e986178d None None] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:19.750700 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff075229-da99-469c-9805-ff25d6513e71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:19.751309 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff075229-da99-469c-9805-ff25d6513e71 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:19.751587 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff075229-da99-469c-9805-ff25d6513e71 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:19.751856 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff075229-da99-469c-9805-ff25d6513e71 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:19.780551 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecca98b-9c11-4fed-a9f3-de05b009e1e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:19.781178 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecca98b-9c11-4fed-a9f3-de05b009e1e9 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:19.781456 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecca98b-9c11-4fed-a9f3-de05b009e1e9 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:19.781724 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecca98b-9c11-4fed-a9f3-de05b009e1e9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:19.788741 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:19.794412 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecca98b-9c11-4fed-a9f3-de05b009e1e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 16:27:19.799239 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application [None req-6ecca98b-9c11-4fed-a9f3-de05b009e1e9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 16:27:19.799239 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:27:19.799239 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:27:19.799239 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:27:19.799239 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:27:19.799239 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:27:19.799239 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:27:19.799239 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:27:19.799239 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:27:19.799239 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:27:19.799239 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:27:19.799239 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:27:19.799239 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 16:27:19.799239 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 16:27:19.799239 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 16:27:19.799239 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 16:27:19.800314 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 16:27:19.800314 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 16:27:19.800314 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 16:27:19.800314 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 16:27:19.800314 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:27:19.800314 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:27:19.800314 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:27:19.800314 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:27:19.800314 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:27:19.800314 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:27:19.800314 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:27:19.800314 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application with Lock( Aug 09 16:27:19.800314 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:27:19.800314 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:27:19.800314 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:27:19.800314 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:27:19.801221 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:27:19.801221 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:27:19.801221 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:27:19.801221 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:27:19.801221 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 16:27:19.801221 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 16:27:19.801221 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 16:27:19.801221 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 16:27:19.801221 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 16:27:19.801221 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 16:27:19.801221 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 16:27:19.801221 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Aug 09 16:27:19.801221 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 310/605] 10.222.0.104 () {56 vars in 1107 bytes} [Tue Aug 9 16:27:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 16:27:19.801221 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecca98b-9c11-4fed-a9f3-de05b009e1e9 None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:19.825299 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff075229-da99-469c-9805-ff25d6513e71 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:19.826789 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff075229-da99-469c-9805-ff25d6513e71 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:19.900457 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecca98b-9c11-4fed-a9f3-de05b009e1e9 None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:19.901963 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:19.924556 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 296/606] 10.222.0.104 () {58 vars in 1287 bytes} [Tue Aug 9 16:27:19 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 16:27:19.925792 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11994d7-1dc4-4e48-ac2e-dcff7959f432 None None] REQUEST_METHOD: `POST` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:19.926108 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11994d7-1dc4-4e48-ac2e-dcff7959f432 None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:19.926382 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11994d7-1dc4-4e48-ac2e-dcff7959f432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:19.938476 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef938975-fa05-4261-82c7-f2418e87fba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:19.939080 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef938975-fa05-4261-82c7-f2418e87fba8 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:19.939356 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef938975-fa05-4261-82c7-f2418e87fba8 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:19.939723 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef938975-fa05-4261-82c7-f2418e87fba8 None admin] PATH_INFO: `/v3/domains` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:19.940363 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef938975-fa05-4261-82c7-f2418e87fba8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:27:19.940663 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef938975-fa05-4261-82c7-f2418e87fba8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:19.942055 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef938975-fa05-4261-82c7-f2418e87fba8 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:19.944337 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.auth.core [None req-e11994d7-1dc4-4e48-ac2e-dcff7959f432 None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:27:19.945518 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.fernet_utils [None req-e11994d7-1dc4-4e48-ac2e-dcff7959f432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:27:19.953246 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 311/607] 10.222.0.104 () {56 vars in 1114 bytes} [Tue Aug 9 16:27:19 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:27:19.953246 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef938975-fa05-4261-82c7-f2418e87fba8 None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:20.015042 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:20.030117 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 297/608] 10.222.0.104 () {58 vars in 1029 bytes} [Tue Aug 9 16:27:19 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 16:27:20.030117 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11994d7-1dc4-4e48-ac2e-dcff7959f432 None None] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:20.059985 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef938975-fa05-4261-82c7-f2418e87fba8 None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:20.093114 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725a0163-596e-4bfb-a8db-b30154b79b39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:20.093717 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725a0163-596e-4bfb-a8db-b30154b79b39 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:20.094015 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725a0163-596e-4bfb-a8db-b30154b79b39 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:20.094286 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725a0163-596e-4bfb-a8db-b30154b79b39 None admin] PATH_INFO: `/v3/roles` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:20.094940 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725a0163-596e-4bfb-a8db-b30154b79b39 None admin] RBAC: Adding query filter params (name=service) {{(pid=87275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:27:20.095241 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725a0163-596e-4bfb-a8db-b30154b79b39 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:20.096607 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725a0163-596e-4bfb-a8db-b30154b79b39 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:20.104374 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 312/609] 10.222.0.104 () {56 vars in 1108 bytes} [Tue Aug 9 16:27:19 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:27:20.105179 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725a0163-596e-4bfb-a8db-b30154b79b39 None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:20.118480 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11994d7-1dc4-4e48-ac2e-dcff7959f432 None None] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:20.128820 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:20.154026 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c23c5d-5a5c-4a38-86c3-6c2598089ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:20.154653 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c23c5d-5a5c-4a38-86c3-6c2598089ddb None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:20.154938 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c23c5d-5a5c-4a38-86c3-6c2598089ddb None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:20.155208 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c23c5d-5a5c-4a38-86c3-6c2598089ddb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:20.164963 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c23c5d-5a5c-4a38-86c3-6c2598089ddb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:20.166427 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c23c5d-5a5c-4a38-86c3-6c2598089ddb None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:20.181427 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application [None req-b2c23c5d-5a5c-4a38-86c3-6c2598089ddb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 16:27:20.181427 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:27:20.181427 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:27:20.181427 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:27:20.181427 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:27:20.181427 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:27:20.181427 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:27:20.181427 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:27:20.181427 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:27:20.181427 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:27:20.181427 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:27:20.181427 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:27:20.181427 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 16:27:20.181427 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 16:27:20.181427 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 16:27:20.181427 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 16:27:20.183320 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:27:20.183320 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:27:20.183320 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:27:20.183320 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:27:20.183320 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:27:20.183320 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:27:20.183320 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:27:20.183320 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application with Lock( Aug 09 16:27:20.183320 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:27:20.183320 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:27:20.183320 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:27:20.183320 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:27:20.183320 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:27:20.183320 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:27:20.183320 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:27:20.183320 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:27:20.183320 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 16:27:20.184999 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 16:27:20.184999 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 16:27:20.184999 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Aug 09 16:27:20.186059 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 298/610] 10.222.0.104 () {56 vars in 1113 bytes} [Tue Aug 9 16:27:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 16:27:20.187142 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c23c5d-5a5c-4a38-86c3-6c2598089ddb None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:20.210809 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725a0163-596e-4bfb-a8db-b30154b79b39 None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:20.231647 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:20.245787 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c896818-a66f-4c01-b274-dce49b4171c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:20.246458 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c896818-a66f-4c01-b274-dce49b4171c5 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:20.246733 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c896818-a66f-4c01-b274-dce49b4171c5 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:20.247007 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c896818-a66f-4c01-b274-dce49b4171c5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:20.253417 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c896818-a66f-4c01-b274-dce49b4171c5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:20.254894 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c896818-a66f-4c01-b274-dce49b4171c5 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:20.265789 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application [None req-8c896818-a66f-4c01-b274-dce49b4171c5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 16:27:20.265789 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:27:20.265789 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:27:20.265789 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:27:20.265789 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:27:20.265789 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:27:20.265789 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:27:20.265789 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:27:20.265789 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:27:20.265789 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:27:20.265789 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:27:20.265789 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:27:20.265789 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 16:27:20.265789 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 16:27:20.265789 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 16:27:20.266885 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 16:27:20.266885 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:27:20.266885 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:27:20.266885 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:27:20.266885 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:27:20.266885 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:27:20.266885 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:27:20.266885 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:27:20.266885 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application with Lock( Aug 09 16:27:20.266885 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:27:20.266885 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:27:20.266885 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:27:20.266885 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:27:20.266885 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:27:20.266885 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:27:20.266885 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:27:20.266885 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:27:20.267988 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 16:27:20.267988 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 16:27:20.267988 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 16:27:20.267988 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 16:27:20.267988 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 16:27:20.267988 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 16:27:20.267988 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 16:27:20.267988 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Aug 09 16:27:20.267988 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 313/611] 10.222.0.104 () {56 vars in 1116 bytes} [Tue Aug 9 16:27:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 16:27:20.267988 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c896818-a66f-4c01-b274-dce49b4171c5 None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:20.288653 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c23c5d-5a5c-4a38-86c3-6c2598089ddb None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:20.322731 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85c34da-fa26-4c3f-a0ac-a1d79d6b7d33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:20.323458 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85c34da-fa26-4c3f-a0ac-a1d79d6b7d33 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:20.323833 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85c34da-fa26-4c3f-a0ac-a1d79d6b7d33 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:20.324201 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85c34da-fa26-4c3f-a0ac-a1d79d6b7d33 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:20.334082 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85c34da-fa26-4c3f-a0ac-a1d79d6b7d33 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 16:27:20.339701 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application [None req-c85c34da-fa26-4c3f-a0ac-a1d79d6b7d33 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 16:27:20.339701 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:27:20.339701 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:27:20.339701 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:27:20.339701 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:27:20.339701 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:27:20.339701 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:27:20.339701 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:27:20.339701 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:27:20.339701 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:27:20.339701 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:27:20.339701 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:27:20.339701 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 16:27:20.339701 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 16:27:20.339701 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 16:27:20.339701 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 16:27:20.340853 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 16:27:20.340853 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 16:27:20.340853 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 16:27:20.340853 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 16:27:20.340853 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:27:20.340853 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:27:20.340853 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:27:20.340853 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:27:20.340853 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:27:20.340853 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:27:20.340853 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:27:20.340853 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application with Lock( Aug 09 16:27:20.340853 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:27:20.340853 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:27:20.340853 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:27:20.340853 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:27:20.341925 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:27:20.341925 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:27:20.341925 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:27:20.341925 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:27:20.341925 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 16:27:20.341925 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 16:27:20.341925 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 16:27:20.341925 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 16:27:20.341925 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 16:27:20.341925 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 16:27:20.341925 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 16:27:20.341925 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Aug 09 16:27:20.341925 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 299/612] 10.222.0.104 () {56 vars in 1107 bytes} [Tue Aug 9 16:27:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 16:27:20.341925 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85c34da-fa26-4c3f-a0ac-a1d79d6b7d33 None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:20.368153 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:20.370005 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c896818-a66f-4c01-b274-dce49b4171c5 None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:20.405324 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776f4262-e5c8-491f-879a-97a249d102be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:20.405979 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776f4262-e5c8-491f-879a-97a249d102be None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:20.406250 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776f4262-e5c8-491f-879a-97a249d102be None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:20.406515 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776f4262-e5c8-491f-879a-97a249d102be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:20.416705 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776f4262-e5c8-491f-879a-97a249d102be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:20.418976 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776f4262-e5c8-491f-879a-97a249d102be None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:20.433796 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application [None req-776f4262-e5c8-491f-879a-97a249d102be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 16:27:20.433796 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:27:20.433796 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:27:20.433796 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:27:20.433796 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:27:20.433796 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:27:20.433796 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:27:20.433796 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:27:20.433796 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:27:20.433796 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:27:20.433796 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:27:20.433796 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:27:20.433796 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 16:27:20.433796 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 16:27:20.433796 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 16:27:20.433796 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 16:27:20.434960 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:27:20.434960 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:27:20.434960 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:27:20.434960 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:27:20.434960 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:27:20.434960 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:27:20.434960 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:27:20.434960 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application with Lock( Aug 09 16:27:20.434960 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:27:20.434960 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:27:20.434960 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:27:20.434960 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:27:20.434960 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:27:20.434960 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:27:20.434960 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:27:20.434960 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:27:20.434960 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 16:27:20.436035 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 16:27:20.436035 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 16:27:20.436035 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Aug 09 16:27:20.436035 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 314/613] 10.222.0.104 () {56 vars in 1113 bytes} [Tue Aug 9 16:27:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 16:27:20.437078 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776f4262-e5c8-491f-879a-97a249d102be None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:20.459179 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85c34da-fa26-4c3f-a0ac-a1d79d6b7d33 None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:20.468936 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:20.493452 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f55caa0-9350-4b72-994f-1cd8381576be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:20.494082 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f55caa0-9350-4b72-994f-1cd8381576be None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:20.494357 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f55caa0-9350-4b72-994f-1cd8381576be None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:20.494633 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f55caa0-9350-4b72-994f-1cd8381576be None admin] PATH_INFO: `/v3/domains` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:20.495333 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f55caa0-9350-4b72-994f-1cd8381576be None admin] RBAC: Adding query filter params (name=Default) {{(pid=87276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:27:20.495639 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f55caa0-9350-4b72-994f-1cd8381576be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:20.497074 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f55caa0-9350-4b72-994f-1cd8381576be None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:20.508873 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 300/614] 10.222.0.104 () {56 vars in 1114 bytes} [Tue Aug 9 16:27:20 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:27:20.509668 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f55caa0-9350-4b72-994f-1cd8381576be None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:20.539082 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776f4262-e5c8-491f-879a-97a249d102be None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:20.571431 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fb0a0f-3d4d-4732-bb44-08777b08fb04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:20.572028 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fb0a0f-3d4d-4732-bb44-08777b08fb04 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:20.572304 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fb0a0f-3d4d-4732-bb44-08777b08fb04 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:20.572575 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fb0a0f-3d4d-4732-bb44-08777b08fb04 None admin] PATH_INFO: `/v3/projects` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:20.573827 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fb0a0f-3d4d-4732-bb44-08777b08fb04 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:27:20.574105 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fb0a0f-3d4d-4732-bb44-08777b08fb04 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:20.575522 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fb0a0f-3d4d-4732-bb44-08777b08fb04 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:20.587050 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 315/615] 10.222.0.104 () {56 vars in 1153 bytes} [Tue Aug 9 16:27:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:27:20.587828 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fb0a0f-3d4d-4732-bb44-08777b08fb04 None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:20.588561 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:20.609828 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f55caa0-9350-4b72-994f-1cd8381576be None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:20.643024 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce36a10-052d-4b55-80eb-1b6a32cc03d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:20.643614 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce36a10-052d-4b55-80eb-1b6a32cc03d7 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:20.643892 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce36a10-052d-4b55-80eb-1b6a32cc03d7 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:20.644153 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce36a10-052d-4b55-80eb-1b6a32cc03d7 None admin] PATH_INFO: `/v3/roles` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:20.644801 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce36a10-052d-4b55-80eb-1b6a32cc03d7 None admin] RBAC: Adding query filter params (name=service) {{(pid=87276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:27:20.645127 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce36a10-052d-4b55-80eb-1b6a32cc03d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:20.646509 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce36a10-052d-4b55-80eb-1b6a32cc03d7 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:20.654914 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 301/616] 10.222.0.104 () {56 vars in 1108 bytes} [Tue Aug 9 16:27:20 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:27:20.655699 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce36a10-052d-4b55-80eb-1b6a32cc03d7 None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:20.682819 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:20.691565 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fb0a0f-3d4d-4732-bb44-08777b08fb04 None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:20.728498 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e07375-a47c-4b2b-90a6-3a60c196fdf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:20.729707 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e07375-a47c-4b2b-90a6-3a60c196fdf8 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:20.730019 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e07375-a47c-4b2b-90a6-3a60c196fdf8 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:20.730288 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e07375-a47c-4b2b-90a6-3a60c196fdf8 None admin] PATH_INFO: `/v3/domains` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:20.730920 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e07375-a47c-4b2b-90a6-3a60c196fdf8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:27:20.731216 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e07375-a47c-4b2b-90a6-3a60c196fdf8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:20.732572 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e07375-a47c-4b2b-90a6-3a60c196fdf8 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:20.743885 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 316/617] 10.222.0.104 () {56 vars in 1114 bytes} [Tue Aug 9 16:27:20 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:27:20.744675 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e07375-a47c-4b2b-90a6-3a60c196fdf8 None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:20.759373 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce36a10-052d-4b55-80eb-1b6a32cc03d7 None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:20.794368 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ce4038-24ef-4c8a-b2a9-7339bad0795f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:20.794988 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ce4038-24ef-4c8a-b2a9-7339bad0795f None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:20.795269 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ce4038-24ef-4c8a-b2a9-7339bad0795f None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:20.795540 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ce4038-24ef-4c8a-b2a9-7339bad0795f None admin] PATH_INFO: `/v3/projects/service` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:20.802047 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ce4038-24ef-4c8a-b2a9-7339bad0795f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:20.803465 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ce4038-24ef-4c8a-b2a9-7339bad0795f None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:20.815152 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application [None req-37ce4038-24ef-4c8a-b2a9-7339bad0795f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 16:27:20.815152 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:27:20.815152 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:27:20.815152 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:27:20.815152 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:27:20.815152 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:27:20.815152 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:27:20.815152 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:27:20.815152 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:27:20.815152 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:27:20.815152 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:27:20.815152 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:27:20.815152 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 16:27:20.815152 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 16:27:20.815152 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 16:27:20.816143 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 16:27:20.816143 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:27:20.816143 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:27:20.816143 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:27:20.816143 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:27:20.816143 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:27:20.816143 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:27:20.816143 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:27:20.816143 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application with Lock( Aug 09 16:27:20.816143 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:27:20.816143 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:27:20.816143 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:27:20.816143 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:27:20.816143 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:27:20.816143 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:27:20.816143 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:27:20.816143 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:27:20.817018 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 16:27:20.817018 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 16:27:20.817018 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 16:27:20.817018 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 16:27:20.817018 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 16:27:20.817018 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 16:27:20.817018 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 16:27:20.817018 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Aug 09 16:27:20.817018 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 302/618] 10.222.0.104 () {56 vars in 1116 bytes} [Tue Aug 9 16:27:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 16:27:20.817507 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ce4038-24ef-4c8a-b2a9-7339bad0795f None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:20.819834 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:20.851948 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e07375-a47c-4b2b-90a6-3a60c196fdf8 None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:20.884935 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0257236-e054-43be-8253-965e40e513d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:20.885575 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0257236-e054-43be-8253-965e40e513d5 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:20.885855 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0257236-e054-43be-8253-965e40e513d5 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:20.886154 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0257236-e054-43be-8253-965e40e513d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:20.886871 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0257236-e054-43be-8253-965e40e513d5 None admin] RBAC: Adding query filter params (role.id=aa624ab843384e48873a8d5a72422836, scope.project.id=63557f0ff1ce4ae49899b4627bafd94e, user.id=b4c33c3fc318484d9cdfae778d23f06a) {{(pid=87275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:27:20.887173 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0257236-e054-43be-8253-965e40e513d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:20.888595 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0257236-e054-43be-8253-965e40e513d5 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:20.894169 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 317/619] 10.222.0.104 () {56 vars in 1379 bytes} [Tue Aug 9 16:27:20 2022] GET /identity/v3/role_assignments?user.id=b4c33c3fc318484d9cdfae778d23f06a&scope.project.id=63557f0ff1ce4ae49899b4627bafd94e&role.id=aa624ab843384e48873a8d5a72422836 => generated 610 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:27:20.894942 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0257236-e054-43be-8253-965e40e513d5 None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:20.918573 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ce4038-24ef-4c8a-b2a9-7339bad0795f None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:20.933181 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:20.958291 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a56eef-b3dd-48e0-a227-e853d2f89a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:20.958946 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a56eef-b3dd-48e0-a227-e853d2f89a1e None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:20.959224 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a56eef-b3dd-48e0-a227-e853d2f89a1e None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:20.959498 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a56eef-b3dd-48e0-a227-e853d2f89a1e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:20.971355 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a56eef-b3dd-48e0-a227-e853d2f89a1e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:20.972848 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a56eef-b3dd-48e0-a227-e853d2f89a1e None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:20.988492 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application [None req-e7a56eef-b3dd-48e0-a227-e853d2f89a1e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 16:27:20.988492 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:27:20.988492 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:27:20.988492 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:27:20.988492 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:27:20.988492 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:27:20.988492 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:27:20.988492 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:27:20.988492 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:27:20.988492 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:27:20.988492 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:27:20.988492 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:27:20.988492 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 16:27:20.988492 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 16:27:20.988492 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 16:27:20.988492 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 16:27:20.989555 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:27:20.989555 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:27:20.989555 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:27:20.989555 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:27:20.989555 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:27:20.989555 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:27:20.989555 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:27:20.989555 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application with Lock( Aug 09 16:27:20.989555 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:27:20.989555 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:27:20.989555 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:27:20.989555 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:27:20.989555 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:27:20.989555 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:27:20.989555 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:27:20.989555 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:27:20.989555 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 16:27:20.990579 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 16:27:20.990579 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 16:27:20.990579 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Aug 09 16:27:20.994718 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 303/620] 10.222.0.104 () {56 vars in 1113 bytes} [Tue Aug 9 16:27:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 16:27:20.996156 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a56eef-b3dd-48e0-a227-e853d2f89a1e None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:21.032467 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0257236-e054-43be-8253-965e40e513d5 None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:21.062785 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:21.074543 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9477e8e4-f41e-4918-bc95-3a4b5b78e8f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:21.075735 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9477e8e4-f41e-4918-bc95-3a4b5b78e8f3 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:21.075735 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9477e8e4-f41e-4918-bc95-3a4b5b78e8f3 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:21.075735 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9477e8e4-f41e-4918-bc95-3a4b5b78e8f3 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:21.089324 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9477e8e4-f41e-4918-bc95-3a4b5b78e8f3 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:21.090815 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9477e8e4-f41e-4918-bc95-3a4b5b78e8f3 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:21.106686 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application [None req-9477e8e4-f41e-4918-bc95-3a4b5b78e8f3 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 09 16:27:21.106686 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:27:21.106686 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:27:21.106686 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:27:21.106686 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:27:21.106686 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:27:21.106686 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:27:21.106686 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:27:21.106686 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:27:21.106686 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:27:21.106686 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:27:21.106686 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:27:21.106686 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 16:27:21.106686 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 16:27:21.106686 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 16:27:21.106686 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 16:27:21.107973 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:27:21.107973 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:27:21.107973 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 16:27:21.107973 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 16:27:21.107973 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 16:27:21.107973 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 16:27:21.107973 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:27:21.107973 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:27:21.107973 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:27:21.107973 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:27:21.107973 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:27:21.107973 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application with Lock( Aug 09 16:27:21.107973 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:27:21.107973 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:27:21.107973 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:27:21.107973 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:27:21.107973 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:27:21.107973 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:27:21.109053 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:27:21.109053 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:27:21.109053 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 16:27:21.109053 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 16:27:21.109053 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 16:27:21.109053 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 16:27:21.109053 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 16:27:21.109053 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 16:27:21.109053 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 09 16:27:21.109053 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Aug 09 16:27:21.109053 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 318/621] 10.222.0.104 () {56 vars in 1104 bytes} [Tue Aug 9 16:27:20 2022] GET /identity/v3/users/cinder => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 16:27:21.109053 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9477e8e4-f41e-4918-bc95-3a4b5b78e8f3 None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:21.122181 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a56eef-b3dd-48e0-a227-e853d2f89a1e None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:21.168341 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20772136-ebe1-4309-a545-b34e73b2647e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:21.168946 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20772136-ebe1-4309-a545-b34e73b2647e None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:21.169221 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20772136-ebe1-4309-a545-b34e73b2647e None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:21.169487 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20772136-ebe1-4309-a545-b34e73b2647e None admin] PATH_INFO: `/v3/projects` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:21.170259 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20772136-ebe1-4309-a545-b34e73b2647e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:27:21.170560 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20772136-ebe1-4309-a545-b34e73b2647e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:21.171978 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20772136-ebe1-4309-a545-b34e73b2647e None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:21.187684 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 304/622] 10.222.0.104 () {56 vars in 1153 bytes} [Tue Aug 9 16:27:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:27:21.188637 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20772136-ebe1-4309-a545-b34e73b2647e None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:21.206213 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:21.231715 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9477e8e4-f41e-4918-bc95-3a4b5b78e8f3 None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:21.267290 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a57afc4-0cc5-48ca-90be-86b4ee4ce43a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:21.267977 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a57afc4-0cc5-48ca-90be-86b4ee4ce43a None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:21.268258 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a57afc4-0cc5-48ca-90be-86b4ee4ce43a None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:21.268527 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a57afc4-0cc5-48ca-90be-86b4ee4ce43a None admin] PATH_INFO: `/v3/domains` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:21.269162 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a57afc4-0cc5-48ca-90be-86b4ee4ce43a None admin] RBAC: Adding query filter params (name=Default) {{(pid=87275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:27:21.269454 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a57afc4-0cc5-48ca-90be-86b4ee4ce43a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:21.270864 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a57afc4-0cc5-48ca-90be-86b4ee4ce43a None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:21.285369 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 319/623] 10.222.0.104 () {56 vars in 1114 bytes} [Tue Aug 9 16:27:21 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:27:21.286272 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a57afc4-0cc5-48ca-90be-86b4ee4ce43a None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:21.309593 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20772136-ebe1-4309-a545-b34e73b2647e None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:21.324324 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:21.345289 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b36606d-3c5c-45fa-a7fc-7b784839eda7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:21.346060 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b36606d-3c5c-45fa-a7fc-7b784839eda7 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:21.346323 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b36606d-3c5c-45fa-a7fc-7b784839eda7 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:21.346593 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b36606d-3c5c-45fa-a7fc-7b784839eda7 None admin] PATH_INFO: `/v3/users` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:21.347315 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b36606d-3c5c-45fa-a7fc-7b784839eda7 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=87276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:27:21.347616 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b36606d-3c5c-45fa-a7fc-7b784839eda7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:21.349052 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b36606d-3c5c-45fa-a7fc-7b784839eda7 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:21.370789 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 305/624] 10.222.0.104 () {56 vars in 1142 bytes} [Tue Aug 9 16:27:21 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 374 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:27:21.370789 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b36606d-3c5c-45fa-a7fc-7b784839eda7 None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:21.398184 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a57afc4-0cc5-48ca-90be-86b4ee4ce43a None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:21.434850 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a6eb80-8fe5-4ace-8bfd-c3ca355cb525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:21.435571 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a6eb80-8fe5-4ace-8bfd-c3ca355cb525 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:21.435749 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a6eb80-8fe5-4ace-8bfd-c3ca355cb525 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:21.435991 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a6eb80-8fe5-4ace-8bfd-c3ca355cb525 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:21.436769 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a6eb80-8fe5-4ace-8bfd-c3ca355cb525 None admin] RBAC: Adding query filter params (role.id=aa624ab843384e48873a8d5a72422836, scope.project.id=63557f0ff1ce4ae49899b4627bafd94e, user.id=717261252a9a44de8a71c10fda7082b0) {{(pid=87275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:27:21.437006 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a6eb80-8fe5-4ace-8bfd-c3ca355cb525 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:21.438475 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a6eb80-8fe5-4ace-8bfd-c3ca355cb525 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:21.442076 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:21.446027 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 320/625] 10.222.0.104 () {56 vars in 1379 bytes} [Tue Aug 9 16:27:21 2022] GET /identity/v3/role_assignments?user.id=717261252a9a44de8a71c10fda7082b0&scope.project.id=63557f0ff1ce4ae49899b4627bafd94e&role.id=aa624ab843384e48873a8d5a72422836 => generated 610 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:27:21.447254 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a6eb80-8fe5-4ace-8bfd-c3ca355cb525 None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:21.500137 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b36606d-3c5c-45fa-a7fc-7b784839eda7 None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:21.551113 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10516d00-7440-4fcd-bc70-e45b64fd8291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:21.552078 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10516d00-7440-4fcd-bc70-e45b64fd8291 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:21.552360 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10516d00-7440-4fcd-bc70-e45b64fd8291 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:21.552658 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10516d00-7440-4fcd-bc70-e45b64fd8291 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:21.564507 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10516d00-7440-4fcd-bc70-e45b64fd8291 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:21.566723 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10516d00-7440-4fcd-bc70-e45b64fd8291 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:21.571271 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a6eb80-8fe5-4ace-8bfd-c3ca355cb525 None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:21.583396 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application [None req-10516d00-7440-4fcd-bc70-e45b64fd8291 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 09 16:27:21.583396 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:27:21.583396 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:27:21.583396 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:27:21.583396 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:27:21.583396 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:27:21.583396 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:27:21.583396 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:27:21.583396 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:27:21.583396 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:27:21.583396 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:27:21.583396 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:27:21.583396 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 16:27:21.583396 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 16:27:21.583396 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 16:27:21.583396 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 16:27:21.584572 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:27:21.584572 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:27:21.584572 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 16:27:21.584572 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 16:27:21.584572 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 16:27:21.584572 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 16:27:21.584572 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:27:21.584572 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:27:21.584572 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:27:21.584572 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:27:21.584572 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:27:21.584572 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application with Lock( Aug 09 16:27:21.584572 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:27:21.584572 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:27:21.584572 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:27:21.584572 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:27:21.584572 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:27:21.584572 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:27:21.585938 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:27:21.585938 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:27:21.585938 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 16:27:21.585938 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 16:27:21.585938 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 16:27:21.585938 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 16:27:21.585938 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 16:27:21.585938 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 16:27:21.585938 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 09 16:27:21.585938 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Aug 09 16:27:21.585938 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 306/626] 10.222.0.104 () {56 vars in 1107 bytes} [Tue Aug 9 16:27:21 2022] GET /identity/v3/users/neutron => generated 85 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 16:27:21.591034 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10516d00-7440-4fcd-bc70-e45b64fd8291 None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:21.622004 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1838e1a-2e24-41f4-861e-abb3e029694c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:21.622552 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1838e1a-2e24-41f4-861e-abb3e029694c None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:21.622834 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1838e1a-2e24-41f4-861e-abb3e029694c None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:21.623110 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1838e1a-2e24-41f4-861e-abb3e029694c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:21.636975 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:21.702608 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:21.706365 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1838e1a-2e24-41f4-861e-abb3e029694c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:21.708044 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1838e1a-2e24-41f4-861e-abb3e029694c None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:21.721306 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10516d00-7440-4fcd-bc70-e45b64fd8291 None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:21.766276 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38856a6-96cf-4a1f-b42f-651c92c34326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:21.766893 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38856a6-96cf-4a1f-b42f-651c92c34326 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:21.767171 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38856a6-96cf-4a1f-b42f-651c92c34326 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:21.767822 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38856a6-96cf-4a1f-b42f-651c92c34326 None admin] PATH_INFO: `/v3/users` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:21.768829 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38856a6-96cf-4a1f-b42f-651c92c34326 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=87276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:27:21.769176 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38856a6-96cf-4a1f-b42f-651c92c34326 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:21.770622 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38856a6-96cf-4a1f-b42f-651c92c34326 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:21.793121 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 307/627] 10.222.0.104 () {56 vars in 1144 bytes} [Tue Aug 9 16:27:21 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 376 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:27:21.798809 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38856a6-96cf-4a1f-b42f-651c92c34326 None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:21.844755 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 321/628] 10.222.0.104 () {58 vars in 1287 bytes} [Tue Aug 9 16:27:21 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 16:27:21.851556 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1838e1a-2e24-41f4-861e-abb3e029694c None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:21.907679 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:21.920040 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38856a6-96cf-4a1f-b42f-651c92c34326 None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:21.964025 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c58b62-eccd-4664-82f9-a6e9bbee33c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:21.965014 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c58b62-eccd-4664-82f9-a6e9bbee33c6 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:21.965490 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c58b62-eccd-4664-82f9-a6e9bbee33c6 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:21.966501 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c58b62-eccd-4664-82f9-a6e9bbee33c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:21.976479 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:21.980559 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1838e1a-2e24-41f4-861e-abb3e029694c None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:22.019382 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc73492-5489-4f32-9511-d80a880edcf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:22.019863 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc73492-5489-4f32-9511-d80a880edcf6 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:22.020622 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc73492-5489-4f32-9511-d80a880edcf6 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:22.020622 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc73492-5489-4f32-9511-d80a880edcf6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:22.036959 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc73492-5489-4f32-9511-d80a880edcf6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:22.038610 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc73492-5489-4f32-9511-d80a880edcf6 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:22.054832 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application [None req-2dc73492-5489-4f32-9511-d80a880edcf6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 16:27:22.054832 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:27:22.054832 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:27:22.054832 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:27:22.054832 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:27:22.054832 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:27:22.054832 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:27:22.054832 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:27:22.054832 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:27:22.054832 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:27:22.054832 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:27:22.054832 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:27:22.054832 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 16:27:22.054832 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 16:27:22.054832 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 16:27:22.054832 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 16:27:22.056503 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:27:22.056503 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:27:22.056503 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:27:22.056503 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:27:22.056503 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:27:22.056503 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:27:22.056503 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:27:22.056503 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application with Lock( Aug 09 16:27:22.056503 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:27:22.056503 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:27:22.056503 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:27:22.056503 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:27:22.056503 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:27:22.056503 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:27:22.056503 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:27:22.056503 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:27:22.056503 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 16:27:22.058275 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 16:27:22.058275 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 16:27:22.058275 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Aug 09 16:27:22.063698 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 322/629] 10.222.0.104 () {56 vars in 1113 bytes} [Tue Aug 9 16:27:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 16:27:22.064695 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc73492-5489-4f32-9511-d80a880edcf6 None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:22.073758 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c58b62-eccd-4664-82f9-a6e9bbee33c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:22.076093 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c58b62-eccd-4664-82f9-a6e9bbee33c6 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:22.177934 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc73492-5489-4f32-9511-d80a880edcf6 None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:22.196785 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:22.211049 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 308/630] 10.222.0.104 () {58 vars in 1287 bytes} [Tue Aug 9 16:27:21 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 09 16:27:22.216928 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c58b62-eccd-4664-82f9-a6e9bbee33c6 None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:22.218110 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405aef4f-55fa-4509-a6c6-fb59c9ccc67c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:22.218779 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405aef4f-55fa-4509-a6c6-fb59c9ccc67c None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:22.219056 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405aef4f-55fa-4509-a6c6-fb59c9ccc67c None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:22.219326 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405aef4f-55fa-4509-a6c6-fb59c9ccc67c None admin] PATH_INFO: `/v3/domains` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:22.220103 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405aef4f-55fa-4509-a6c6-fb59c9ccc67c None admin] RBAC: Adding query filter params (name=Default) {{(pid=87275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:27:22.220406 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405aef4f-55fa-4509-a6c6-fb59c9ccc67c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:22.221881 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405aef4f-55fa-4509-a6c6-fb59c9ccc67c None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:22.235011 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 323/631] 10.222.0.104 () {56 vars in 1114 bytes} [Tue Aug 9 16:27:22 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:27:22.240582 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405aef4f-55fa-4509-a6c6-fb59c9ccc67c None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:22.258104 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:22.332601 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c58b62-eccd-4664-82f9-a6e9bbee33c6 None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:22.369871 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a514c80-02dd-426a-9ee6-a308aacfc6fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:22.370573 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a514c80-02dd-426a-9ee6-a308aacfc6fa None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:22.370905 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a514c80-02dd-426a-9ee6-a308aacfc6fa None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:22.371177 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a514c80-02dd-426a-9ee6-a308aacfc6fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:22.381721 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a514c80-02dd-426a-9ee6-a308aacfc6fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:22.382666 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405aef4f-55fa-4509-a6c6-fb59c9ccc67c None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:22.383290 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a514c80-02dd-426a-9ee6-a308aacfc6fa None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:22.399098 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application [None req-2a514c80-02dd-426a-9ee6-a308aacfc6fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 16:27:22.399098 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:27:22.399098 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:27:22.399098 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:27:22.399098 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:27:22.399098 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:27:22.399098 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:27:22.399098 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:27:22.399098 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:27:22.399098 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:27:22.399098 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:27:22.399098 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:27:22.399098 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 16:27:22.399098 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 16:27:22.399098 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 16:27:22.399098 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 16:27:22.400067 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:27:22.400067 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:27:22.400067 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:27:22.400067 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:27:22.400067 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:27:22.400067 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:27:22.400067 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:27:22.400067 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application with Lock( Aug 09 16:27:22.400067 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:27:22.400067 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:27:22.400067 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:27:22.400067 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:27:22.400067 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:27:22.400067 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:27:22.400067 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:27:22.400067 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:27:22.400067 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 16:27:22.401494 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 16:27:22.401494 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 16:27:22.401494 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Aug 09 16:27:22.401494 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 309/632] 10.222.0.104 () {56 vars in 1113 bytes} [Tue Aug 9 16:27:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 16:27:22.405949 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a514c80-02dd-426a-9ee6-a308aacfc6fa None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:22.431056 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c8b63f-ae3d-4d4e-a000-9aa71fd22a39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:22.432032 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c8b63f-ae3d-4d4e-a000-9aa71fd22a39 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:22.432515 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c8b63f-ae3d-4d4e-a000-9aa71fd22a39 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:22.433034 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c8b63f-ae3d-4d4e-a000-9aa71fd22a39 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:22.440097 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c8b63f-ae3d-4d4e-a000-9aa71fd22a39 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:22.441641 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c8b63f-ae3d-4d4e-a000-9aa71fd22a39 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:22.454483 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application [None req-81c8b63f-ae3d-4d4e-a000-9aa71fd22a39 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 16:27:22.454483 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:27:22.454483 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:27:22.454483 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:27:22.454483 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:27:22.454483 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:27:22.454483 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:27:22.454483 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:27:22.454483 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:27:22.454483 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:27:22.454483 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:27:22.454483 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:27:22.454483 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 16:27:22.454483 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 16:27:22.454483 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 16:27:22.455628 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 16:27:22.455628 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:27:22.455628 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:27:22.455628 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:27:22.455628 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:27:22.455628 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:27:22.455628 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:27:22.455628 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:27:22.455628 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application with Lock( Aug 09 16:27:22.455628 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:27:22.455628 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:27:22.455628 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:27:22.455628 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:27:22.455628 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:27:22.455628 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:27:22.455628 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:27:22.455628 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:27:22.456540 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 16:27:22.456540 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 16:27:22.456540 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 16:27:22.456540 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 16:27:22.456540 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 16:27:22.456540 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 16:27:22.456540 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 16:27:22.456540 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Aug 09 16:27:22.461369 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 324/633] 10.222.0.104 () {56 vars in 1116 bytes} [Tue Aug 9 16:27:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 16:27:22.462675 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c8b63f-ae3d-4d4e-a000-9aa71fd22a39 None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:22.466296 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:22.542200 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:22.546097 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a514c80-02dd-426a-9ee6-a308aacfc6fa None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:22.574340 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c8b63f-ae3d-4d4e-a000-9aa71fd22a39 None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:22.591059 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fe5bec-3bb2-48dc-a98f-e508bbc1bbc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:22.592224 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fe5bec-3bb2-48dc-a98f-e508bbc1bbc3 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:22.592722 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fe5bec-3bb2-48dc-a98f-e508bbc1bbc3 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:22.593338 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fe5bec-3bb2-48dc-a98f-e508bbc1bbc3 None admin] PATH_INFO: `/v3/domains` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:22.594634 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fe5bec-3bb2-48dc-a98f-e508bbc1bbc3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:27:22.595122 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fe5bec-3bb2-48dc-a98f-e508bbc1bbc3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:22.596668 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fe5bec-3bb2-48dc-a98f-e508bbc1bbc3 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:22.612561 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21426b8a-a6ff-4354-9ff1-3a5592c46e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:22.613252 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21426b8a-a6ff-4354-9ff1-3a5592c46e5e None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:22.613606 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21426b8a-a6ff-4354-9ff1-3a5592c46e5e None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:22.614047 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21426b8a-a6ff-4354-9ff1-3a5592c46e5e None admin] PATH_INFO: `/v3/projects` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:22.618814 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21426b8a-a6ff-4354-9ff1-3a5592c46e5e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:27:22.618814 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21426b8a-a6ff-4354-9ff1-3a5592c46e5e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:22.618814 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21426b8a-a6ff-4354-9ff1-3a5592c46e5e None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:22.619347 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 310/634] 10.222.0.104 () {56 vars in 1114 bytes} [Tue Aug 9 16:27:22 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 16:27:22.620838 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fe5bec-3bb2-48dc-a98f-e508bbc1bbc3 None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:22.635507 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 325/635] 10.222.0.104 () {56 vars in 1153 bytes} [Tue Aug 9 16:27:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 16:27:22.636855 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21426b8a-a6ff-4354-9ff1-3a5592c46e5e None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:22.743030 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fe5bec-3bb2-48dc-a98f-e508bbc1bbc3 None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:22.744883 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:22.767203 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21426b8a-a6ff-4354-9ff1-3a5592c46e5e None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:22.802320 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcd7fbb-339e-4b2c-9e17-c60187da3651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:22.803546 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcd7fbb-339e-4b2c-9e17-c60187da3651 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:22.804260 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcd7fbb-339e-4b2c-9e17-c60187da3651 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:22.804718 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcd7fbb-339e-4b2c-9e17-c60187da3651 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:22.807827 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:22.816498 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f03728-e123-48ca-907d-dfd0186893e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:22.817333 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f03728-e123-48ca-907d-dfd0186893e0 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:22.817689 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f03728-e123-48ca-907d-dfd0186893e0 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:22.818569 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f03728-e123-48ca-907d-dfd0186893e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:22.818802 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcd7fbb-339e-4b2c-9e17-c60187da3651 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:22.819035 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f03728-e123-48ca-907d-dfd0186893e0 None admin] RBAC: Adding query filter params (role.id=aa624ab843384e48873a8d5a72422836, scope.project.id=63557f0ff1ce4ae49899b4627bafd94e, user.id=e914013dfd8b448e8cdbd6b8399cfd0c) {{(pid=87275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:27:22.819684 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f03728-e123-48ca-907d-dfd0186893e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:22.820861 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcd7fbb-339e-4b2c-9e17-c60187da3651 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:22.824635 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f03728-e123-48ca-907d-dfd0186893e0 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:22.837930 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 326/636] 10.222.0.104 () {56 vars in 1379 bytes} [Tue Aug 9 16:27:22 2022] GET /identity/v3/role_assignments?user.id=e914013dfd8b448e8cdbd6b8399cfd0c&scope.project.id=63557f0ff1ce4ae49899b4627bafd94e&role.id=aa624ab843384e48873a8d5a72422836 => generated 610 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:27:22.843419 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application [None req-2fcd7fbb-339e-4b2c-9e17-c60187da3651 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 16:27:22.843419 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:27:22.843419 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:27:22.843419 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:27:22.843419 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:27:22.843419 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:27:22.843419 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:27:22.843419 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:27:22.843419 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:27:22.843419 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:27:22.843419 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:27:22.843419 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:27:22.843419 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 16:27:22.843419 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 16:27:22.843419 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 16:27:22.844396 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 16:27:22.844396 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:27:22.844396 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:27:22.844396 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:27:22.844396 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:27:22.844396 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:27:22.844396 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:27:22.844396 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:27:22.844396 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application with Lock( Aug 09 16:27:22.844396 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:27:22.844396 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:27:22.844396 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:27:22.844396 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:27:22.844396 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:27:22.844396 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:27:22.844396 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:27:22.844396 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:27:22.845777 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 16:27:22.845777 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 16:27:22.845777 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 16:27:22.845777 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 16:27:22.845777 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 16:27:22.845777 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 16:27:22.845777 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 16:27:22.845777 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Aug 09 16:27:22.845777 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 311/637] 10.222.0.104 () {56 vars in 1116 bytes} [Tue Aug 9 16:27:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 16:27:22.850776 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f03728-e123-48ca-907d-dfd0186893e0 None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:22.961511 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f03728-e123-48ca-907d-dfd0186893e0 None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:22.999073 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad66b64e-f85b-4c37-8887-14b9acf94ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:22.999687 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad66b64e-f85b-4c37-8887-14b9acf94ae5 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:22.999900 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad66b64e-f85b-4c37-8887-14b9acf94ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:23.000140 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad66b64e-f85b-4c37-8887-14b9acf94ae5 None admin] PATH_INFO: `/v3/projects` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:23.000836 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad66b64e-f85b-4c37-8887-14b9acf94ae5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:27:23.001143 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad66b64e-f85b-4c37-8887-14b9acf94ae5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:23.002887 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad66b64e-f85b-4c37-8887-14b9acf94ae5 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:23.017135 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 327/638] 10.222.0.104 () {56 vars in 1153 bytes} [Tue Aug 9 16:27:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:27:23.023253 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcd7fbb-339e-4b2c-9e17-c60187da3651 None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:23.138977 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcd7fbb-339e-4b2c-9e17-c60187da3651 None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:23.173371 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2e87a2-3d8e-4368-8d04-88cdae280c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:23.174007 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2e87a2-3d8e-4368-8d04-88cdae280c52 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:23.174289 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2e87a2-3d8e-4368-8d04-88cdae280c52 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:23.174563 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2e87a2-3d8e-4368-8d04-88cdae280c52 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:23.175292 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2e87a2-3d8e-4368-8d04-88cdae280c52 None admin] RBAC: Adding query filter params (role.id=aa624ab843384e48873a8d5a72422836, scope.project.id=63557f0ff1ce4ae49899b4627bafd94e, user.id=da49ba8d1a21406eac55503b42fea65b) {{(pid=87276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:27:23.175600 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2e87a2-3d8e-4368-8d04-88cdae280c52 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:23.177042 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2e87a2-3d8e-4368-8d04-88cdae280c52 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:23.184174 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 312/639] 10.222.0.104 () {56 vars in 1379 bytes} [Tue Aug 9 16:27:23 2022] GET /identity/v3/role_assignments?user.id=da49ba8d1a21406eac55503b42fea65b&scope.project.id=63557f0ff1ce4ae49899b4627bafd94e&role.id=aa624ab843384e48873a8d5a72422836 => generated 610 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:27:23.310736 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56072f75-734d-4bf2-86a7-9c287fa349c2 None None] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:23.310914 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56072f75-734d-4bf2-86a7-9c287fa349c2 None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:23.311198 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56072f75-734d-4bf2-86a7-9c287fa349c2 None None] PATH_INFO: `/` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:23.312894 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 328/640] 10.222.0.104 () {54 vars in 932 bytes} [Tue Aug 9 16:27:23 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:27:23.319532 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107b2398-b935-4862-a899-9c99ebd02086 None None] REQUEST_METHOD: `POST` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:23.319882 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107b2398-b935-4862-a899-9c99ebd02086 None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:23.320158 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107b2398-b935-4862-a899-9c99ebd02086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:23.340741 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.auth.core [None req-107b2398-b935-4862-a899-9c99ebd02086 None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:27:23.342013 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.fernet_utils [None req-107b2398-b935-4862-a899-9c99ebd02086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:27:23.366045 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:23.417512 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 313/641] 10.222.0.104 () {58 vars in 1029 bytes} [Tue Aug 9 16:27:23 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 16:27:23.447189 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56072f75-734d-4bf2-86a7-9c287fa349c2 None None] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:23.515832 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:23.567651 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56072f75-734d-4bf2-86a7-9c287fa349c2 None None] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:23.605312 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed5e263-4262-4e13-80c3-ede9a1e54c0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:23.606224 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed5e263-4262-4e13-80c3-ede9a1e54c0c None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:23.606679 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed5e263-4262-4e13-80c3-ede9a1e54c0c None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:23.607101 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed5e263-4262-4e13-80c3-ede9a1e54c0c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:23.618116 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed5e263-4262-4e13-80c3-ede9a1e54c0c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 16:27:23.623172 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application [None req-bed5e263-4262-4e13-80c3-ede9a1e54c0c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 16:27:23.623172 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:27:23.623172 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:27:23.623172 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:27:23.623172 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:27:23.623172 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:27:23.623172 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:27:23.623172 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:27:23.623172 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:27:23.623172 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:27:23.623172 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:27:23.623172 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:27:23.623172 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 16:27:23.623172 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 16:27:23.623172 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 16:27:23.623172 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 16:27:23.624386 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 16:27:23.624386 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 16:27:23.624386 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 16:27:23.624386 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 16:27:23.624386 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:27:23.624386 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:27:23.624386 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:27:23.624386 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:27:23.624386 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:27:23.624386 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:27:23.624386 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:27:23.624386 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application with Lock( Aug 09 16:27:23.624386 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:27:23.624386 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:27:23.624386 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:27:23.624386 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:27:23.625528 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:27:23.625528 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:27:23.625528 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:27:23.625528 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:27:23.625528 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 16:27:23.625528 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 16:27:23.625528 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 16:27:23.625528 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 16:27:23.625528 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 16:27:23.625528 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 16:27:23.625528 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 16:27:23.625528 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Aug 09 16:27:23.627885 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 329/642] 10.222.0.104 () {56 vars in 1101 bytes} [Tue Aug 9 16:27:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 16:27:23.637952 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107b2398-b935-4862-a899-9c99ebd02086 None None] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:23.745958 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107b2398-b935-4862-a899-9c99ebd02086 None None] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:23.793925 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22341447-9b77-4cc3-946c-9d485878bee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:23.793925 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22341447-9b77-4cc3-946c-9d485878bee7 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:23.793925 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22341447-9b77-4cc3-946c-9d485878bee7 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:23.793925 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22341447-9b77-4cc3-946c-9d485878bee7 None admin] PATH_INFO: `/v3/roles` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:23.794399 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22341447-9b77-4cc3-946c-9d485878bee7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:27:23.794399 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22341447-9b77-4cc3-946c-9d485878bee7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:23.794399 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22341447-9b77-4cc3-946c-9d485878bee7 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:23.799754 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 314/643] 10.222.0.104 () {56 vars in 1104 bytes} [Tue Aug 9 16:27:23 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:27:23.806851 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed5e263-4262-4e13-80c3-ede9a1e54c0c None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:23.993553 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed5e263-4262-4e13-80c3-ede9a1e54c0c None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:24.002200 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a45a01-7f24-4bfa-9f6d-4a8f5957df01 None None] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:24.002483 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a45a01-7f24-4bfa-9f6d-4a8f5957df01 None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:24.002759 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a45a01-7f24-4bfa-9f6d-4a8f5957df01 None None] PATH_INFO: `/` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:24.004313 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 315/644] 10.222.0.104 () {54 vars in 932 bytes} [Tue Aug 9 16:27:24 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:27:24.009162 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cb5f48-c149-45c4-8944-82d66f320bc1 None None] REQUEST_METHOD: `POST` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:24.009440 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cb5f48-c149-45c4-8944-82d66f320bc1 None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:24.009709 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cb5f48-c149-45c4-8944-82d66f320bc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:24.012448 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:24.029811 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.auth.core [None req-d4cb5f48-c149-45c4-8944-82d66f320bc1 None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:27:24.031144 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.fernet_utils [None req-d4cb5f48-c149-45c4-8944-82d66f320bc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:27:24.033982 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdd3cb9-0a78-434e-86f9-4e492ffe9e14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:24.034620 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdd3cb9-0a78-434e-86f9-4e492ffe9e14 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:24.034900 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdd3cb9-0a78-434e-86f9-4e492ffe9e14 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:24.035471 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdd3cb9-0a78-434e-86f9-4e492ffe9e14 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:24.050420 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdd3cb9-0a78-434e-86f9-4e492ffe9e14 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:24.052568 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdd3cb9-0a78-434e-86f9-4e492ffe9e14 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:24.053930 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:24.073637 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application [None req-2bdd3cb9-0a78-434e-86f9-4e492ffe9e14 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 16:27:24.073637 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:27:24.073637 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:27:24.073637 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:27:24.073637 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:27:24.073637 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:27:24.073637 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:27:24.073637 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:27:24.073637 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:27:24.073637 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:27:24.073637 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:27:24.073637 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:27:24.073637 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 16:27:24.073637 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 16:27:24.073637 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 16:27:24.073637 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 16:27:24.074652 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:27:24.074652 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:27:24.074652 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:27:24.074652 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:27:24.074652 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:27:24.074652 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:27:24.074652 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:27:24.074652 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application with Lock( Aug 09 16:27:24.074652 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:27:24.074652 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:27:24.074652 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:27:24.074652 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:27:24.074652 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:27:24.074652 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:27:24.074652 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:27:24.074652 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:27:24.074652 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 16:27:24.075544 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 16:27:24.075544 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 16:27:24.075544 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Aug 09 16:27:24.076304 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 330/645] 10.222.0.104 () {56 vars in 1113 bytes} [Tue Aug 9 16:27:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 16:27:24.081054 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdd3cb9-0a78-434e-86f9-4e492ffe9e14 None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:24.122066 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 316/646] 10.222.0.104 () {58 vars in 1029 bytes} [Tue Aug 9 16:27:24 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 16:27:24.140970 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cb5f48-c149-45c4-8944-82d66f320bc1 None None] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:24.201864 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdd3cb9-0a78-434e-86f9-4e492ffe9e14 None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:24.239283 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0e91e1-d885-4e0d-9b35-790d9434888b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:24.240237 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0e91e1-d885-4e0d-9b35-790d9434888b None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:24.240819 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0e91e1-d885-4e0d-9b35-790d9434888b None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:24.241396 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0e91e1-d885-4e0d-9b35-790d9434888b None admin] PATH_INFO: `/v3/domains` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:24.242374 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0e91e1-d885-4e0d-9b35-790d9434888b None admin] RBAC: Adding query filter params (name=Default) {{(pid=87275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:27:24.242946 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0e91e1-d885-4e0d-9b35-790d9434888b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:24.245163 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0e91e1-d885-4e0d-9b35-790d9434888b None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:24.245402 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cb5f48-c149-45c4-8944-82d66f320bc1 None None] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:24.258614 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 331/647] 10.222.0.104 () {56 vars in 1114 bytes} [Tue Aug 9 16:27:24 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 16:27:24.264806 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0e91e1-d885-4e0d-9b35-790d9434888b None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:24.289724 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144e934e-0a98-45e5-a76a-a42673c43c5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:24.291812 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144e934e-0a98-45e5-a76a-a42673c43c5a None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:24.292437 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144e934e-0a98-45e5-a76a-a42673c43c5a None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:24.293041 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144e934e-0a98-45e5-a76a-a42673c43c5a None admin] PATH_INFO: `/v3/services/image` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:24.293816 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144e934e-0a98-45e5-a76a-a42673c43c5a None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:24.295848 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144e934e-0a98-45e5-a76a-a42673c43c5a None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:24.298356 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:24.310395 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application [None req-144e934e-0a98-45e5-a76a-a42673c43c5a None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 09 16:27:24.310395 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:27:24.310395 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 16:27:24.310395 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 16:27:24.310395 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 16:27:24.310395 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 16:27:24.310395 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 16:27:24.310395 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 16:27:24.310395 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 09 16:27:24.310395 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Aug 09 16:27:24.310395 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 16:27:24.310395 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Aug 09 16:27:24.310395 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:27:24.310395 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:27:24.310395 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:27:24.310395 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:27:24.310395 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:27:24.311659 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:27:24.311659 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:27:24.311659 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:27:24.311659 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:27:24.311659 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:27:24.311659 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:27:24.311659 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 16:27:24.311659 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 16:27:24.311659 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 16:27:24.311659 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 16:27:24.311659 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:27:24.311659 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:27:24.311659 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:27:24.311659 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:27:24.311659 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:27:24.311659 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:27:24.312496 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:27:24.312496 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application with Lock( Aug 09 16:27:24.312496 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:27:24.312496 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:27:24.312496 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:27:24.312496 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:27:24.312496 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:27:24.312496 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:27:24.312496 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:27:24.312496 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:27:24.312496 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 16:27:24.312496 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 16:27:24.312496 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 09 16:27:24.312496 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Aug 09 16:27:24.319791 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 317/648] 10.222.0.104 () {56 vars in 1110 bytes} [Tue Aug 9 16:27:24 2022] GET /identity/v3/services/image => generated 86 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 16:27:24.321031 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144e934e-0a98-45e5-a76a-a42673c43c5a None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:24.337777 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:24.388017 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0e91e1-d885-4e0d-9b35-790d9434888b None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:24.428256 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac21833-0f95-4ad0-9f7a-69f63940c7f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:24.429261 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac21833-0f95-4ad0-9f7a-69f63940c7f1 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:24.429735 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac21833-0f95-4ad0-9f7a-69f63940c7f1 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:24.430546 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac21833-0f95-4ad0-9f7a-69f63940c7f1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:24.438780 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac21833-0f95-4ad0-9f7a-69f63940c7f1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:24.440438 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac21833-0f95-4ad0-9f7a-69f63940c7f1 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:24.448186 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144e934e-0a98-45e5-a76a-a42673c43c5a None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:24.453191 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application [None req-1ac21833-0f95-4ad0-9f7a-69f63940c7f1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 09 16:27:24.453191 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:27:24.453191 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:27:24.453191 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:27:24.453191 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:27:24.453191 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:27:24.453191 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:27:24.453191 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:27:24.453191 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:27:24.453191 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:27:24.453191 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:27:24.453191 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:27:24.453191 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 16:27:24.453191 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 16:27:24.453191 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 16:27:24.453191 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 16:27:24.454445 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:27:24.454445 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:27:24.454445 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 16:27:24.454445 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 16:27:24.454445 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 16:27:24.454445 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 16:27:24.454445 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:27:24.454445 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:27:24.454445 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:27:24.454445 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:27:24.454445 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:27:24.454445 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application with Lock( Aug 09 16:27:24.454445 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:27:24.454445 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:27:24.454445 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:27:24.454445 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:27:24.454445 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:27:24.454445 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:27:24.455372 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:27:24.455372 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:27:24.455372 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 16:27:24.455372 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 16:27:24.455372 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 16:27:24.455372 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 16:27:24.455372 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 16:27:24.455372 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 16:27:24.455372 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 09 16:27:24.455372 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Aug 09 16:27:24.457692 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 332/649] 10.222.0.104 () {56 vars in 1098 bytes} [Tue Aug 9 16:27:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 16:27:24.462833 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac21833-0f95-4ad0-9f7a-69f63940c7f1 None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:24.489711 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bd10af-ac3b-4bea-8a58-bcd415a9e63b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:24.490759 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bd10af-ac3b-4bea-8a58-bcd415a9e63b None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:24.491282 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bd10af-ac3b-4bea-8a58-bcd415a9e63b None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:24.491741 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bd10af-ac3b-4bea-8a58-bcd415a9e63b None admin] PATH_INFO: `/v3/services` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:24.492554 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bd10af-ac3b-4bea-8a58-bcd415a9e63b None admin] RBAC: Adding query filter params (name=image) {{(pid=87276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:27:24.493082 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bd10af-ac3b-4bea-8a58-bcd415a9e63b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:24.495799 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bd10af-ac3b-4bea-8a58-bcd415a9e63b None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:24.501027 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 318/650] 10.222.0.104 () {56 vars in 1113 bytes} [Tue Aug 9 16:27:24 2022] GET /identity/v3/services?name=image => generated 123 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:27:24.506624 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bd10af-ac3b-4bea-8a58-bcd415a9e63b None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:24.582037 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:24.598725 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac21833-0f95-4ad0-9f7a-69f63940c7f1 None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:24.624244 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:24.642070 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bd10af-ac3b-4bea-8a58-bcd415a9e63b None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:24.646538 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6455bac9-4bb0-4681-9a27-27f3888ab22c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:24.647435 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6455bac9-4bb0-4681-9a27-27f3888ab22c None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:24.647949 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6455bac9-4bb0-4681-9a27-27f3888ab22c None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:24.648422 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6455bac9-4bb0-4681-9a27-27f3888ab22c None admin] PATH_INFO: `/v3/users` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:24.650013 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6455bac9-4bb0-4681-9a27-27f3888ab22c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:27:24.650630 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6455bac9-4bb0-4681-9a27-27f3888ab22c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:24.652753 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6455bac9-4bb0-4681-9a27-27f3888ab22c None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:24.681050 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 333/651] 10.222.0.104 () {56 vars in 1138 bytes} [Tue Aug 9 16:27:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:27:24.683134 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6455bac9-4bb0-4681-9a27-27f3888ab22c None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:24.689307 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bcde7a-6d4b-496e-89f7-b16cefa7e3dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:24.689994 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bcde7a-6d4b-496e-89f7-b16cefa7e3dd None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:24.690274 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bcde7a-6d4b-496e-89f7-b16cefa7e3dd None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:24.690586 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bcde7a-6d4b-496e-89f7-b16cefa7e3dd None admin] PATH_INFO: `/v3/services` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:24.691211 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bcde7a-6d4b-496e-89f7-b16cefa7e3dd None admin] RBAC: Adding query filter params (type=image) {{(pid=87276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:27:24.691511 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bcde7a-6d4b-496e-89f7-b16cefa7e3dd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:24.692917 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bcde7a-6d4b-496e-89f7-b16cefa7e3dd None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:24.705927 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 319/652] 10.222.0.104 () {56 vars in 1113 bytes} [Tue Aug 9 16:27:24 2022] GET /identity/v3/services?type=image => generated 123 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:27:24.816341 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6455bac9-4bb0-4681-9a27-27f3888ab22c None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:24.854256 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a1a7d9-5c99-4aa3-8ba2-323aca4250e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:24.854881 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a1a7d9-5c99-4aa3-8ba2-323aca4250e4 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:24.855159 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a1a7d9-5c99-4aa3-8ba2-323aca4250e4 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:24.855432 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a1a7d9-5c99-4aa3-8ba2-323aca4250e4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:24.873824 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:24.931414 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a1a7d9-5c99-4aa3-8ba2-323aca4250e4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:24.933449 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a1a7d9-5c99-4aa3-8ba2-323aca4250e4 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:25.039066 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 334/653] 10.222.0.104 () {58 vars in 1287 bytes} [Tue Aug 9 16:27:24 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 16:27:25.046692 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bcde7a-6d4b-496e-89f7-b16cefa7e3dd None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:25.161378 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bcde7a-6d4b-496e-89f7-b16cefa7e3dd None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:25.199146 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f104fc0-9152-4ef7-99f2-13c3110febff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:25.199789 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f104fc0-9152-4ef7-99f2-13c3110febff None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:25.200070 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f104fc0-9152-4ef7-99f2-13c3110febff None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:25.200343 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f104fc0-9152-4ef7-99f2-13c3110febff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:25.209779 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:25.212390 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f104fc0-9152-4ef7-99f2-13c3110febff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:25.213928 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f104fc0-9152-4ef7-99f2-13c3110febff None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:25.229429 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application [None req-8f104fc0-9152-4ef7-99f2-13c3110febff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 16:27:25.229429 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:27:25.229429 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:27:25.229429 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:27:25.229429 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:27:25.229429 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:27:25.229429 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:27:25.229429 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:27:25.229429 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:27:25.229429 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:27:25.229429 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:27:25.229429 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:27:25.229429 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 16:27:25.229429 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 16:27:25.229429 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 16:27:25.229429 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 16:27:25.230472 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:27:25.230472 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:27:25.230472 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:27:25.230472 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:27:25.230472 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:27:25.230472 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:27:25.230472 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:27:25.230472 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application with Lock( Aug 09 16:27:25.230472 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:27:25.230472 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:27:25.230472 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:27:25.230472 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:27:25.230472 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:27:25.230472 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:27:25.230472 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:27:25.230472 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:27:25.230472 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 16:27:25.231360 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 16:27:25.231360 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 16:27:25.231360 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Aug 09 16:27:25.231360 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 320/654] 10.222.0.104 () {56 vars in 1113 bytes} [Tue Aug 9 16:27:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 16:27:25.236482 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a1a7d9-5c99-4aa3-8ba2-323aca4250e4 None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:25.285287 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:25.342121 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a1a7d9-5c99-4aa3-8ba2-323aca4250e4 None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:25.352358 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bb43f9-fa13-4cef-91f3-a082bd0cdcad None None] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:25.352661 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bb43f9-fa13-4cef-91f3-a082bd0cdcad None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:25.352912 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bb43f9-fa13-4cef-91f3-a082bd0cdcad None None] PATH_INFO: `/` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:25.354825 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 321/655] 10.222.0.104 () {54 vars in 932 bytes} [Tue Aug 9 16:27:25 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:27:25.360112 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8945031-7e39-43f9-85bf-5987040af67e None None] REQUEST_METHOD: `POST` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:25.360399 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8945031-7e39-43f9-85bf-5987040af67e None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:25.360676 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8945031-7e39-43f9-85bf-5987040af67e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:25.378668 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.auth.core [None req-c8945031-7e39-43f9-85bf-5987040af67e None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:27:25.379875 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.fernet_utils [None req-c8945031-7e39-43f9-85bf-5987040af67e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:27:25.380293 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7836da-c61d-424b-85c8-19ab975aa33e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:25.380907 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7836da-c61d-424b-85c8-19ab975aa33e None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:25.381186 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7836da-c61d-424b-85c8-19ab975aa33e None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:25.381460 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7836da-c61d-424b-85c8-19ab975aa33e None admin] PATH_INFO: `/v3/domains` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:25.382454 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7836da-c61d-424b-85c8-19ab975aa33e None admin] RBAC: Adding query filter params (name=Default) {{(pid=87275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:27:25.383656 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7836da-c61d-424b-85c8-19ab975aa33e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:25.385087 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7836da-c61d-424b-85c8-19ab975aa33e None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:25.400053 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 335/656] 10.222.0.104 () {56 vars in 1114 bytes} [Tue Aug 9 16:27:25 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:27:25.405970 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7836da-c61d-424b-85c8-19ab975aa33e None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:25.466387 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 322/657] 10.222.0.104 () {58 vars in 1029 bytes} [Tue Aug 9 16:27:25 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 16:27:25.496112 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8945031-7e39-43f9-85bf-5987040af67e None None] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:25.529199 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7836da-c61d-424b-85c8-19ab975aa33e None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:25.540584 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:25.580733 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc0e94d-becc-4046-864e-0ba43b61aafa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:25.581367 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc0e94d-becc-4046-864e-0ba43b61aafa None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:25.581643 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc0e94d-becc-4046-864e-0ba43b61aafa None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:25.581925 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc0e94d-becc-4046-864e-0ba43b61aafa None admin] PATH_INFO: `/v3/projects/service` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:25.589680 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc0e94d-becc-4046-864e-0ba43b61aafa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:25.591156 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc0e94d-becc-4046-864e-0ba43b61aafa None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:25.603219 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application [None req-6cc0e94d-becc-4046-864e-0ba43b61aafa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 16:27:25.603219 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:27:25.603219 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:27:25.603219 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:27:25.603219 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:27:25.603219 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:27:25.603219 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:27:25.603219 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:27:25.603219 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:27:25.603219 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:27:25.603219 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:27:25.603219 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:27:25.603219 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 16:27:25.603219 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 16:27:25.603219 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 16:27:25.604736 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 16:27:25.604736 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:27:25.604736 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:27:25.604736 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:27:25.604736 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:27:25.604736 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:27:25.604736 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:27:25.604736 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:27:25.604736 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application with Lock( Aug 09 16:27:25.604736 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:27:25.604736 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:27:25.604736 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:27:25.604736 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:27:25.604736 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:27:25.604736 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:27:25.604736 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:27:25.604736 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:27:25.605636 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 16:27:25.605636 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 16:27:25.605636 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 16:27:25.605636 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 16:27:25.605636 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 16:27:25.605636 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 16:27:25.605636 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 16:27:25.605636 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Aug 09 16:27:25.609659 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 336/658] 10.222.0.104 () {56 vars in 1116 bytes} [Tue Aug 9 16:27:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 16:27:25.610992 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc0e94d-becc-4046-864e-0ba43b61aafa None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:25.624497 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8945031-7e39-43f9-85bf-5987040af67e None None] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:25.657194 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:25.670893 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4967e1-ed97-46c3-8a74-370ced51864d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:25.671715 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4967e1-ed97-46c3-8a74-370ced51864d None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:25.672135 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4967e1-ed97-46c3-8a74-370ced51864d None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:25.672498 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4967e1-ed97-46c3-8a74-370ced51864d None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:25.673185 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4967e1-ed97-46c3-8a74-370ced51864d None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:25.674684 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4967e1-ed97-46c3-8a74-370ced51864d None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:25.684153 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application [None req-1a4967e1-ed97-46c3-8a74-370ced51864d None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 09 16:27:25.684153 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:27:25.684153 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 16:27:25.684153 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 16:27:25.684153 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 16:27:25.684153 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 16:27:25.684153 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 16:27:25.684153 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 16:27:25.684153 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 09 16:27:25.684153 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Aug 09 16:27:25.684153 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 16:27:25.684153 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Aug 09 16:27:25.684153 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:27:25.684153 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:27:25.684153 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:27:25.684153 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:27:25.684153 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:27:25.685540 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:27:25.685540 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:27:25.685540 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:27:25.685540 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:27:25.685540 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:27:25.685540 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:27:25.685540 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 16:27:25.685540 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 16:27:25.685540 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 16:27:25.685540 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 16:27:25.685540 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:27:25.685540 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:27:25.685540 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:27:25.685540 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:27:25.685540 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:27:25.685540 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:27:25.686631 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:27:25.686631 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application with Lock( Aug 09 16:27:25.686631 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:27:25.686631 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:27:25.686631 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:27:25.686631 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:27:25.686631 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:27:25.686631 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:27:25.686631 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:27:25.686631 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:27:25.686631 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 16:27:25.686631 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 16:27:25.686631 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 09 16:27:25.686631 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Aug 09 16:27:25.693397 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 323/659] 10.222.0.104 () {56 vars in 1134 bytes} [Tue Aug 9 16:27:25 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 16:27:25.694472 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4967e1-ed97-46c3-8a74-370ced51864d None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:25.746009 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc0e94d-becc-4046-864e-0ba43b61aafa None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:25.784795 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf9ab97-ebcb-4f6a-b50c-a107c3ed9b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:25.785401 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf9ab97-ebcb-4f6a-b50c-a107c3ed9b37 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:25.785678 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf9ab97-ebcb-4f6a-b50c-a107c3ed9b37 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:25.785974 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf9ab97-ebcb-4f6a-b50c-a107c3ed9b37 None admin] PATH_INFO: `/v3/projects` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:25.786658 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf9ab97-ebcb-4f6a-b50c-a107c3ed9b37 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:27:25.786962 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf9ab97-ebcb-4f6a-b50c-a107c3ed9b37 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:25.788384 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf9ab97-ebcb-4f6a-b50c-a107c3ed9b37 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:25.805723 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 337/660] 10.222.0.104 () {56 vars in 1153 bytes} [Tue Aug 9 16:27:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 16:27:25.805723 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e4b881-2901-4346-9757-e61065745dee None None] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:25.805723 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e4b881-2901-4346-9757-e61065745dee None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:25.805723 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e4b881-2901-4346-9757-e61065745dee None None] PATH_INFO: `/` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:25.808063 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 338/661] 10.222.0.104 () {54 vars in 932 bytes} [Tue Aug 9 16:27:25 2022] GET /identity => generated 271 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:27:25.808857 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e4b881-2901-4346-9757-e61065745dee None None] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:25.819809 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4967e1-ed97-46c3-8a74-370ced51864d None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:25.843391 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:25.859721 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442e58ba-2357-4fdf-8f51-c42da8b386f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:25.860574 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442e58ba-2357-4fdf-8f51-c42da8b386f9 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:25.860997 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442e58ba-2357-4fdf-8f51-c42da8b386f9 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:25.861410 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442e58ba-2357-4fdf-8f51-c42da8b386f9 None admin] PATH_INFO: `/v3/services` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:25.862214 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442e58ba-2357-4fdf-8f51-c42da8b386f9 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=87276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:27:25.862664 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442e58ba-2357-4fdf-8f51-c42da8b386f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:25.864034 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442e58ba-2357-4fdf-8f51-c42da8b386f9 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:25.868542 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 324/662] 10.222.0.104 () {56 vars in 1129 bytes} [Tue Aug 9 16:27:25 2022] GET /identity/v3/services?name=block-storage => generated 131 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 16:27:25.869774 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a6df18-e72b-4df4-aba4-3b95353d303d None None] REQUEST_METHOD: `POST` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:25.870094 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a6df18-e72b-4df4-aba4-3b95353d303d None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:25.870362 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a6df18-e72b-4df4-aba4-3b95353d303d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:25.888872 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.auth.core [None req-e1a6df18-e72b-4df4-aba4-3b95353d303d None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:27:25.890009 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.fernet_utils [None req-e1a6df18-e72b-4df4-aba4-3b95353d303d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:27:25.936547 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e4b881-2901-4346-9757-e61065745dee None None] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:25.948917 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:25.973645 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 325/663] 10.222.0.104 () {58 vars in 1029 bytes} [Tue Aug 9 16:27:25 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 16:27:25.974688 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a6df18-e72b-4df4-aba4-3b95353d303d None None] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:25.981781 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cbf7bf-e7e4-4d50-8667-688776116540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:25.982416 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cbf7bf-e7e4-4d50-8667-688776116540 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:25.982787 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cbf7bf-e7e4-4d50-8667-688776116540 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:25.983101 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cbf7bf-e7e4-4d50-8667-688776116540 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:25.984023 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cbf7bf-e7e4-4d50-8667-688776116540 None admin] RBAC: Adding query filter params (role.id=c0143e35c1344a39a931bbb6bcd5acdc, scope.project.id=63557f0ff1ce4ae49899b4627bafd94e, user.id=b4c33c3fc318484d9cdfae778d23f06a) {{(pid=87275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:27:25.984334 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cbf7bf-e7e4-4d50-8667-688776116540 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:25.986009 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cbf7bf-e7e4-4d50-8667-688776116540 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:25.993033 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 339/664] 10.222.0.104 () {56 vars in 1379 bytes} [Tue Aug 9 16:27:25 2022] GET /identity/v3/role_assignments?user.id=b4c33c3fc318484d9cdfae778d23f06a&scope.project.id=63557f0ff1ce4ae49899b4627bafd94e&role.id=c0143e35c1344a39a931bbb6bcd5acdc => generated 260 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:27:26.000628 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cbf7bf-e7e4-4d50-8667-688776116540 None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:26.109597 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:26.116695 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a6df18-e72b-4df4-aba4-3b95353d303d None None] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:26.122954 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cbf7bf-e7e4-4d50-8667-688776116540 None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:26.160683 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5032e043-2327-4443-849a-66a1f0aa1b6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:26.161889 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5032e043-2327-4443-849a-66a1f0aa1b6a None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:26.162408 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5032e043-2327-4443-849a-66a1f0aa1b6a None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:26.162630 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b54012c-909a-46cb-a673-8fc27106d573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:26.163122 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5032e043-2327-4443-849a-66a1f0aa1b6a None admin] PATH_INFO: `/v3/services/network` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:26.163230 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b54012c-909a-46cb-a673-8fc27106d573 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:26.163510 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b54012c-909a-46cb-a673-8fc27106d573 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:26.163776 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b54012c-909a-46cb-a673-8fc27106d573 None admin] PATH_INFO: `/v3/services` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:26.164449 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5032e043-2327-4443-849a-66a1f0aa1b6a None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:26.164568 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b54012c-909a-46cb-a673-8fc27106d573 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=87276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:27:26.164906 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b54012c-909a-46cb-a673-8fc27106d573 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:26.166650 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5032e043-2327-4443-849a-66a1f0aa1b6a None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:26.167585 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b54012c-909a-46cb-a673-8fc27106d573 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:26.173301 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 326/665] 10.222.0.104 () {56 vars in 1129 bytes} [Tue Aug 9 16:27:25 2022] GET /identity/v3/services?type=block-storage => generated 131 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:27:26.179404 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application [None req-5032e043-2327-4443-849a-66a1f0aa1b6a None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 09 16:27:26.179404 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:27:26.179404 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 16:27:26.179404 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 16:27:26.179404 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 16:27:26.179404 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 16:27:26.179404 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 16:27:26.179404 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 16:27:26.179404 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 09 16:27:26.179404 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Aug 09 16:27:26.179404 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 16:27:26.179404 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Aug 09 16:27:26.179404 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:27:26.179404 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:27:26.179404 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:27:26.179404 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:27:26.179404 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:27:26.180772 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:27:26.180772 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:27:26.180772 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:27:26.180772 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:27:26.180772 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:27:26.180772 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:27:26.180772 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 16:27:26.180772 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 16:27:26.180772 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 16:27:26.180772 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 16:27:26.180772 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:27:26.180772 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:27:26.180772 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:27:26.180772 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:27:26.180772 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:27:26.180772 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:27:26.181593 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:27:26.181593 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application with Lock( Aug 09 16:27:26.181593 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:27:26.181593 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:27:26.181593 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:27:26.181593 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:27:26.181593 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:27:26.181593 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:27:26.181593 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:27:26.181593 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:27:26.181593 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 16:27:26.181593 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 16:27:26.181593 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 09 16:27:26.181593 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Aug 09 16:27:26.185317 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 340/666] 10.222.0.104 () {56 vars in 1116 bytes} [Tue Aug 9 16:27:25 2022] GET /identity/v3/services/network => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 16:27:26.193756 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b54012c-909a-46cb-a673-8fc27106d573 None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:26.254339 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:26.310546 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b54012c-909a-46cb-a673-8fc27106d573 None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:26.349581 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be983317-f0af-4cf0-bd54-27dc95310ff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:26.350293 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be983317-f0af-4cf0-bd54-27dc95310ff9 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:26.350570 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be983317-f0af-4cf0-bd54-27dc95310ff9 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:26.350839 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be983317-f0af-4cf0-bd54-27dc95310ff9 None admin] PATH_INFO: `/v3/services` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:26.351476 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be983317-f0af-4cf0-bd54-27dc95310ff9 None admin] RBAC: Adding query filter params (name=network) {{(pid=87276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:27:26.351777 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be983317-f0af-4cf0-bd54-27dc95310ff9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:26.353171 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be983317-f0af-4cf0-bd54-27dc95310ff9 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:26.358783 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 327/667] 10.222.0.104 () {56 vars in 1117 bytes} [Tue Aug 9 16:27:26 2022] GET /identity/v3/services?name=network => generated 125 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 16:27:26.364091 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5032e043-2327-4443-849a-66a1f0aa1b6a None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:26.482948 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5032e043-2327-4443-849a-66a1f0aa1b6a None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:26.520003 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3e1d1c-f648-4dfd-b1d4-635def00c43a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:26.520682 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3e1d1c-f648-4dfd-b1d4-635def00c43a None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:26.520975 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3e1d1c-f648-4dfd-b1d4-635def00c43a None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:26.521243 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3e1d1c-f648-4dfd-b1d4-635def00c43a None admin] PATH_INFO: `/v3/services` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:26.521873 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3e1d1c-f648-4dfd-b1d4-635def00c43a None admin] RBAC: Adding query filter params (type=network) {{(pid=87275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:27:26.522201 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3e1d1c-f648-4dfd-b1d4-635def00c43a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:26.523638 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3e1d1c-f648-4dfd-b1d4-635def00c43a None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:26.530017 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 341/668] 10.222.0.104 () {56 vars in 1117 bytes} [Tue Aug 9 16:27:26 2022] GET /identity/v3/services?type=network => generated 125 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:27:27.251742 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635dc348-bfeb-4528-8e25-28bc4c74315d None None] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:27.252263 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635dc348-bfeb-4528-8e25-28bc4c74315d None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:27.252533 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635dc348-bfeb-4528-8e25-28bc4c74315d None None] PATH_INFO: `/` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:27.254469 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 328/669] 10.222.0.104 () {54 vars in 932 bytes} [Tue Aug 9 16:27:27 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:27:27.260164 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5276f884-c7d3-4b3b-b7db-f19ea3c1eeab None None] REQUEST_METHOD: `POST` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:27.260599 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5276f884-c7d3-4b3b-b7db-f19ea3c1eeab None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:27.260781 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5276f884-c7d3-4b3b-b7db-f19ea3c1eeab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:27.279461 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.auth.core [None req-5276f884-c7d3-4b3b-b7db-f19ea3c1eeab None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:27:27.280595 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.fernet_utils [None req-5276f884-c7d3-4b3b-b7db-f19ea3c1eeab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:27:27.295402 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:27.352470 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 342/670] 10.222.0.104 () {58 vars in 1029 bytes} [Tue Aug 9 16:27:27 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 16:27:27.382505 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635dc348-bfeb-4528-8e25-28bc4c74315d None None] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:27.500076 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635dc348-bfeb-4528-8e25-28bc4c74315d None None] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:27.509649 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:27.542491 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6130d2-ff88-4b91-b018-ee223fa183e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:27.543517 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6130d2-ff88-4b91-b018-ee223fa183e1 None admin] REQUEST_METHOD: `POST` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:27.543935 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6130d2-ff88-4b91-b018-ee223fa183e1 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:27.544346 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6130d2-ff88-4b91-b018-ee223fa183e1 None admin] PATH_INFO: `/v3/services` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:27.545311 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6130d2-ff88-4b91-b018-ee223fa183e1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:27.546868 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6130d2-ff88-4b91-b018-ee223fa183e1 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:27.568164 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 329/671] 10.222.0.104 () {60 vars in 1146 bytes} [Tue Aug 9 16:27:27 2022] POST /identity/v3/services => generated 243 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 16:27:28.395423 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be8a80a-99e2-4cfc-8abc-acfb3948117c None None] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:28.395992 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be8a80a-99e2-4cfc-8abc-acfb3948117c None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:28.395992 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be8a80a-99e2-4cfc-8abc-acfb3948117c None None] PATH_INFO: `/` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:28.397612 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 343/672] 10.222.0.104 () {54 vars in 932 bytes} [Tue Aug 9 16:27:28 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:27:28.404094 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e02c85-0eb5-4c18-b464-5aaba66e8168 None None] REQUEST_METHOD: `POST` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:28.405062 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e02c85-0eb5-4c18-b464-5aaba66e8168 None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:28.405548 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e02c85-0eb5-4c18-b464-5aaba66e8168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:28.425481 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.auth.core [None req-80e02c85-0eb5-4c18-b464-5aaba66e8168 None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:27:28.427101 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.fernet_utils [None req-80e02c85-0eb5-4c18-b464-5aaba66e8168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:27:28.514760 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 330/673] 10.222.0.104 () {58 vars in 1029 bytes} [Tue Aug 9 16:27:28 2022] POST /identity/v3/auth/tokens => generated 896 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 16:27:28.538717 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be8a80a-99e2-4cfc-8abc-acfb3948117c None None] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:28.643217 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec586aa-ab9c-4e2d-82dd-a21aef4d2705 None None] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:28.643543 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec586aa-ab9c-4e2d-82dd-a21aef4d2705 None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:28.643774 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec586aa-ab9c-4e2d-82dd-a21aef4d2705 None None] PATH_INFO: `/` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:28.645223 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 331/674] 10.222.0.104 () {54 vars in 932 bytes} [Tue Aug 9 16:27:28 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:27:28.651338 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35172fd4-21b0-46fa-8810-a6e3d70e1089 None None] REQUEST_METHOD: `POST` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:28.651850 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35172fd4-21b0-46fa-8810-a6e3d70e1089 None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:28.652115 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be8a80a-99e2-4cfc-8abc-acfb3948117c None None] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:28.652575 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35172fd4-21b0-46fa-8810-a6e3d70e1089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:28.671007 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.auth.core [None req-35172fd4-21b0-46fa-8810-a6e3d70e1089 None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:27:28.672521 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.fernet_utils [None req-35172fd4-21b0-46fa-8810-a6e3d70e1089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:27:28.692927 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3fdf89-1604-46f1-9b63-3f7e385f864e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:28.693571 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3fdf89-1604-46f1-9b63-3f7e385f864e None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:28.693853 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3fdf89-1604-46f1-9b63-3f7e385f864e None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:28.694156 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3fdf89-1604-46f1-9b63-3f7e385f864e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:28.710980 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3fdf89-1604-46f1-9b63-3f7e385f864e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 16:27:28.718111 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application [None req-2e3fdf89-1604-46f1-9b63-3f7e385f864e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 16:27:28.718111 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:27:28.718111 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:27:28.718111 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:27:28.718111 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:27:28.718111 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:27:28.718111 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:27:28.718111 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:27:28.718111 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:27:28.718111 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:27:28.718111 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:27:28.718111 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:27:28.718111 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 16:27:28.718111 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 16:27:28.718111 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 16:27:28.718111 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 16:27:28.719149 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 16:27:28.719149 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 16:27:28.719149 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 16:27:28.719149 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 16:27:28.719149 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:27:28.719149 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:27:28.719149 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:27:28.719149 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:27:28.719149 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:27:28.719149 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:27:28.719149 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:27:28.719149 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application with Lock( Aug 09 16:27:28.719149 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:27:28.719149 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:27:28.719149 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:27:28.719149 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:27:28.720011 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:27:28.720011 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:27:28.720011 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:27:28.720011 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:27:28.720011 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 16:27:28.720011 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 16:27:28.720011 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 16:27:28.720011 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 16:27:28.720011 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 16:27:28.720011 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 16:27:28.720011 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 16:27:28.720011 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Aug 09 16:27:28.720011 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 344/675] 10.222.0.104 () {56 vars in 1101 bytes} [Tue Aug 9 16:27:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 16:27:28.727588 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3fdf89-1604-46f1-9b63-3f7e385f864e None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:28.746817 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:28.765210 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 332/676] 10.222.0.104 () {58 vars in 1029 bytes} [Tue Aug 9 16:27:28 2022] POST /identity/v3/auth/tokens => generated 896 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 16:27:28.795402 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35172fd4-21b0-46fa-8810-a6e3d70e1089 None None] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:28.823692 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:28.865489 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3fdf89-1604-46f1-9b63-3f7e385f864e None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:28.910476 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35172fd4-21b0-46fa-8810-a6e3d70e1089 None None] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:28.913010 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4851e9c4-810b-40ff-84b0-9daad0dcf2eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:28.914080 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4851e9c4-810b-40ff-84b0-9daad0dcf2eb None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:28.914569 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4851e9c4-810b-40ff-84b0-9daad0dcf2eb None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:28.915046 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4851e9c4-810b-40ff-84b0-9daad0dcf2eb None admin] PATH_INFO: `/v3/roles` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:28.915933 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4851e9c4-810b-40ff-84b0-9daad0dcf2eb None admin] RBAC: Adding query filter params (name=admin) {{(pid=87275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:27:28.916435 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4851e9c4-810b-40ff-84b0-9daad0dcf2eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:28.918100 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4851e9c4-810b-40ff-84b0-9daad0dcf2eb None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:28.927309 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 345/677] 10.222.0.104 () {56 vars in 1104 bytes} [Tue Aug 9 16:27:28 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:27:28.933593 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4851e9c4-810b-40ff-84b0-9daad0dcf2eb None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:28.951667 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ede5b5-5378-4683-bc60-a6238b6e0bb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:28.952271 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ede5b5-5378-4683-bc60-a6238b6e0bb5 None admin] REQUEST_METHOD: `POST` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:28.952549 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ede5b5-5378-4683-bc60-a6238b6e0bb5 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:28.952821 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ede5b5-5378-4683-bc60-a6238b6e0bb5 None admin] PATH_INFO: `/v3/services` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:28.953460 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ede5b5-5378-4683-bc60-a6238b6e0bb5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:28.954864 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ede5b5-5378-4683-bc60-a6238b6e0bb5 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:28.973486 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 333/678] 10.222.0.104 () {60 vars in 1146 bytes} [Tue Aug 9 16:27:28 2022] POST /identity/v3/services => generated 252 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 16:27:28.975652 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8df8d1a-a359-4e74-9c59-a2c8d3c5a5c2 None None] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:28.976126 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8df8d1a-a359-4e74-9c59-a2c8d3c5a5c2 None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:28.976580 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8df8d1a-a359-4e74-9c59-a2c8d3c5a5c2 None None] PATH_INFO: `/` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:28.984547 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 334/679] 10.222.0.104 () {54 vars in 932 bytes} [Tue Aug 9 16:27:28 2022] GET /identity => generated 271 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:27:28.986271 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5981f5-11a9-42b7-a4cd-9ed6d987975e None None] REQUEST_METHOD: `POST` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:28.987325 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5981f5-11a9-42b7-a4cd-9ed6d987975e None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:28.987835 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5981f5-11a9-42b7-a4cd-9ed6d987975e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:29.014212 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.auth.core [None req-fb5981f5-11a9-42b7-a4cd-9ed6d987975e None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:27:29.015810 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.fernet_utils [None req-fb5981f5-11a9-42b7-a4cd-9ed6d987975e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:27:29.022219 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:29.068819 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4851e9c4-810b-40ff-84b0-9daad0dcf2eb None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:29.115237 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534500e1-5751-4af8-8671-7df7ffab8b36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:29.116297 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534500e1-5751-4af8-8671-7df7ffab8b36 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:29.118134 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534500e1-5751-4af8-8671-7df7ffab8b36 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:29.118657 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534500e1-5751-4af8-8671-7df7ffab8b36 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:29.132240 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534500e1-5751-4af8-8671-7df7ffab8b36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:29.134231 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534500e1-5751-4af8-8671-7df7ffab8b36 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:29.138070 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 335/680] 10.222.0.104 () {58 vars in 1029 bytes} [Tue Aug 9 16:27:28 2022] POST /identity/v3/auth/tokens => generated 1000 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 16:27:29.153797 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application [None req-534500e1-5751-4af8-8671-7df7ffab8b36 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 16:27:29.153797 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:27:29.153797 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:27:29.153797 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:27:29.153797 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:27:29.153797 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:27:29.153797 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:27:29.153797 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:27:29.153797 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:27:29.153797 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:27:29.153797 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:27:29.153797 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:27:29.153797 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 16:27:29.153797 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 16:27:29.153797 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 16:27:29.153797 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 16:27:29.154836 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:27:29.154836 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:27:29.154836 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:27:29.154836 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:27:29.154836 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:27:29.154836 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:27:29.154836 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:27:29.154836 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application with Lock( Aug 09 16:27:29.154836 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:27:29.154836 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:27:29.154836 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:27:29.154836 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:27:29.154836 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:27:29.154836 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:27:29.154836 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:27:29.154836 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:27:29.154836 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 16:27:29.155758 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 16:27:29.155758 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 16:27:29.155758 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Aug 09 16:27:29.157998 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 346/681] 10.222.0.104 () {56 vars in 1113 bytes} [Tue Aug 9 16:27:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 16:27:29.159407 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5981f5-11a9-42b7-a4cd-9ed6d987975e None None] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:29.163170 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534500e1-5751-4af8-8671-7df7ffab8b36 None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:29.185314 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:29.290108 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5981f5-11a9-42b7-a4cd-9ed6d987975e None None] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:29.305857 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534500e1-5751-4af8-8671-7df7ffab8b36 None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:29.330088 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d221c38-214f-4838-8417-8747daec97d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:29.330301 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:29.330606 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d221c38-214f-4838-8417-8747daec97d0 None admin] REQUEST_METHOD: `POST` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:29.330896 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d221c38-214f-4838-8417-8747daec97d0 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:29.331170 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d221c38-214f-4838-8417-8747daec97d0 None admin] PATH_INFO: `/v3/services` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:29.332018 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d221c38-214f-4838-8417-8747daec97d0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:29.333564 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d221c38-214f-4838-8417-8747daec97d0 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:29.358532 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008d9e95-8cfc-4840-87e6-b84287af2f78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:29.359665 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008d9e95-8cfc-4840-87e6-b84287af2f78 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:29.360142 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008d9e95-8cfc-4840-87e6-b84287af2f78 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:29.360615 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008d9e95-8cfc-4840-87e6-b84287af2f78 None admin] PATH_INFO: `/v3/domains` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:29.361434 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008d9e95-8cfc-4840-87e6-b84287af2f78 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:27:29.361926 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008d9e95-8cfc-4840-87e6-b84287af2f78 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:29.363565 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008d9e95-8cfc-4840-87e6-b84287af2f78 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:29.364628 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 336/682] 10.222.0.104 () {60 vars in 1146 bytes} [Tue Aug 9 16:27:29 2022] POST /identity/v3/services => generated 241 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 16:27:29.379102 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 347/683] 10.222.0.104 () {56 vars in 1114 bytes} [Tue Aug 9 16:27:29 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 16:27:29.385567 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d221c38-214f-4838-8417-8747daec97d0 None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:29.480656 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:29.522689 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d221c38-214f-4838-8417-8747daec97d0 None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:29.568099 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e6bb57-ee5d-42ff-b6b6-1b83bd3db603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:29.569084 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e6bb57-ee5d-42ff-b6b6-1b83bd3db603 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:29.569545 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e6bb57-ee5d-42ff-b6b6-1b83bd3db603 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:29.570014 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e6bb57-ee5d-42ff-b6b6-1b83bd3db603 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:29.579317 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e6bb57-ee5d-42ff-b6b6-1b83bd3db603 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:29.580763 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e6bb57-ee5d-42ff-b6b6-1b83bd3db603 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:29.594991 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application [None req-b2e6bb57-ee5d-42ff-b6b6-1b83bd3db603 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 09 16:27:29.594991 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:27:29.594991 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:27:29.594991 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:27:29.594991 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:27:29.594991 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:27:29.594991 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:27:29.594991 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:27:29.594991 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:27:29.594991 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:27:29.594991 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:27:29.594991 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:27:29.594991 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 16:27:29.594991 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 16:27:29.594991 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 16:27:29.594991 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 16:27:29.595962 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:27:29.595962 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:27:29.595962 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 16:27:29.595962 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 16:27:29.595962 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 16:27:29.595962 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 16:27:29.595962 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:27:29.595962 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:27:29.595962 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:27:29.595962 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:27:29.595962 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:27:29.595962 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application with Lock( Aug 09 16:27:29.595962 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:27:29.595962 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:27:29.595962 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:27:29.595962 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:27:29.595962 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:27:29.595962 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:27:29.596903 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:27:29.596903 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:27:29.596903 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 16:27:29.596903 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 16:27:29.596903 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 16:27:29.596903 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 16:27:29.596903 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 16:27:29.596903 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 16:27:29.596903 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 09 16:27:29.596903 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Aug 09 16:27:29.596903 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 337/684] 10.222.0.104 () {56 vars in 1098 bytes} [Tue Aug 9 16:27:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 16:27:29.603519 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008d9e95-8cfc-4840-87e6-b84287af2f78 None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:29.715512 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008d9e95-8cfc-4840-87e6-b84287af2f78 None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:29.771046 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c635f82b-354f-4bf1-ae28-893444a1204a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:29.771507 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c635f82b-354f-4bf1-ae28-893444a1204a None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:29.771757 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c635f82b-354f-4bf1-ae28-893444a1204a None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:29.772028 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c635f82b-354f-4bf1-ae28-893444a1204a None admin] PATH_INFO: `/v3/users` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:29.772785 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c635f82b-354f-4bf1-ae28-893444a1204a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:27:29.773188 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c635f82b-354f-4bf1-ae28-893444a1204a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:29.774752 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c635f82b-354f-4bf1-ae28-893444a1204a None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:29.795264 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 348/685] 10.222.0.104 () {56 vars in 1138 bytes} [Tue Aug 9 16:27:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:27:29.800738 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e6bb57-ee5d-42ff-b6b6-1b83bd3db603 None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:29.905471 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e6bb57-ee5d-42ff-b6b6-1b83bd3db603 None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:29.939485 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:29.942369 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95414091-e528-4d9d-a0fa-317f9286733f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:29.943259 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95414091-e528-4d9d-a0fa-317f9286733f None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:29.943751 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95414091-e528-4d9d-a0fa-317f9286733f None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:29.944221 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95414091-e528-4d9d-a0fa-317f9286733f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:29.955908 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95414091-e528-4d9d-a0fa-317f9286733f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:29.957599 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95414091-e528-4d9d-a0fa-317f9286733f None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:29.972169 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application [None req-95414091-e528-4d9d-a0fa-317f9286733f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 16:27:29.972169 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:27:29.972169 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:27:29.972169 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:27:29.972169 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:27:29.972169 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:27:29.972169 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:27:29.972169 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:27:29.972169 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:27:29.972169 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:27:29.972169 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:27:29.972169 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:27:29.972169 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 16:27:29.972169 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 16:27:29.972169 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 16:27:29.972169 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 16:27:29.973120 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:27:29.973120 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:27:29.973120 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:27:29.973120 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:27:29.973120 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:27:29.973120 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:27:29.973120 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:27:29.973120 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application with Lock( Aug 09 16:27:29.973120 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:27:29.973120 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:27:29.973120 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:27:29.973120 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:27:29.973120 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:27:29.973120 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:27:29.973120 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:27:29.973120 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:27:29.973120 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 16:27:29.974090 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 16:27:29.974090 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 16:27:29.974090 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Aug 09 16:27:29.976986 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 338/686] 10.222.0.104 () {56 vars in 1113 bytes} [Tue Aug 9 16:27:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 16:27:29.982681 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c635f82b-354f-4bf1-ae28-893444a1204a None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:29.985247 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b43bf0-3c08-43b5-82df-12ecb6b73e1e None None] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:29.985531 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b43bf0-3c08-43b5-82df-12ecb6b73e1e None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:29.985806 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b43bf0-3c08-43b5-82df-12ecb6b73e1e None None] PATH_INFO: `/` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:29.987379 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 339/687] 10.222.0.104 () {54 vars in 932 bytes} [Tue Aug 9 16:27:29 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 09 16:27:29.992315 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0622de35-3143-4cf2-90ef-f229503466fd None None] REQUEST_METHOD: `POST` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:29.992595 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0622de35-3143-4cf2-90ef-f229503466fd None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:29.992866 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0622de35-3143-4cf2-90ef-f229503466fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:30.012131 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.auth.core [None req-0622de35-3143-4cf2-90ef-f229503466fd None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:27:30.013325 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.fernet_utils [None req-0622de35-3143-4cf2-90ef-f229503466fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:27:30.028252 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:30.094502 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 340/688] 10.222.0.104 () {58 vars in 1029 bytes} [Tue Aug 9 16:27:29 2022] POST /identity/v3/auth/tokens => generated 1099 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 09 16:27:30.112691 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0622de35-3143-4cf2-90ef-f229503466fd None None] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:30.114268 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c635f82b-354f-4bf1-ae28-893444a1204a None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:30.165321 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3620919-66e2-468a-a423-87f5f936e3a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:30.167232 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3620919-66e2-468a-a423-87f5f936e3a5 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:30.167736 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3620919-66e2-468a-a423-87f5f936e3a5 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:30.168281 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3620919-66e2-468a-a423-87f5f936e3a5 None admin] PATH_INFO: `/v3/domains` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:30.169163 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3620919-66e2-468a-a423-87f5f936e3a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:27:30.170218 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3620919-66e2-468a-a423-87f5f936e3a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:30.172082 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3620919-66e2-468a-a423-87f5f936e3a5 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:30.195300 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 349/689] 10.222.0.104 () {56 vars in 1114 bytes} [Tue Aug 9 16:27:29 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:27:30.195944 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3620919-66e2-468a-a423-87f5f936e3a5 None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:30.224085 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0622de35-3143-4cf2-90ef-f229503466fd None None] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:30.239356 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:30.263553 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5204b18d-8729-43d1-acb1-4def6e8467b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:30.264196 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5204b18d-8729-43d1-acb1-4def6e8467b9 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:30.264472 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5204b18d-8729-43d1-acb1-4def6e8467b9 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:30.264806 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5204b18d-8729-43d1-acb1-4def6e8467b9 None admin] PATH_INFO: `/v3/services/image` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:30.265466 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5204b18d-8729-43d1-acb1-4def6e8467b9 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:30.267642 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5204b18d-8729-43d1-acb1-4def6e8467b9 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:30.280396 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application [None req-5204b18d-8729-43d1-acb1-4def6e8467b9 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 09 16:27:30.280396 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:27:30.280396 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 16:27:30.280396 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 16:27:30.280396 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 16:27:30.280396 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 16:27:30.280396 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 16:27:30.280396 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 16:27:30.280396 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 09 16:27:30.280396 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Aug 09 16:27:30.280396 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 16:27:30.280396 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Aug 09 16:27:30.280396 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:27:30.280396 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:27:30.280396 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:27:30.280396 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:27:30.280396 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:27:30.281430 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:27:30.281430 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:27:30.281430 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:27:30.281430 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:27:30.281430 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:27:30.281430 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:27:30.281430 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 16:27:30.281430 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 16:27:30.281430 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 16:27:30.281430 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 16:27:30.281430 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:27:30.281430 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:27:30.281430 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:27:30.281430 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:27:30.281430 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:27:30.281430 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:27:30.282699 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:27:30.282699 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application with Lock( Aug 09 16:27:30.282699 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:27:30.282699 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:27:30.282699 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:27:30.282699 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:27:30.282699 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:27:30.282699 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:27:30.282699 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:27:30.282699 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:27:30.282699 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 16:27:30.282699 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 16:27:30.282699 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 09 16:27:30.282699 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Aug 09 16:27:30.285320 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 341/690] 10.222.0.104 () {56 vars in 1110 bytes} [Tue Aug 9 16:27:30 2022] GET /identity/v3/services/image => generated 86 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 16:27:30.292509 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5204b18d-8729-43d1-acb1-4def6e8467b9 None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:30.339248 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:30.347017 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3620919-66e2-468a-a423-87f5f936e3a5 None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:30.393051 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de71ad1-ce3b-4439-9914-de48a365d65f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:30.393781 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de71ad1-ce3b-4439-9914-de48a365d65f None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:30.394100 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de71ad1-ce3b-4439-9914-de48a365d65f None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:30.394369 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de71ad1-ce3b-4439-9914-de48a365d65f None admin] PATH_INFO: `/v3/projects/service` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:30.404104 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de71ad1-ce3b-4439-9914-de48a365d65f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:30.406295 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de71ad1-ce3b-4439-9914-de48a365d65f None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:30.422529 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application [None req-8de71ad1-ce3b-4439-9914-de48a365d65f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 16:27:30.422529 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:27:30.422529 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:27:30.422529 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:27:30.422529 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:27:30.422529 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:27:30.422529 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:27:30.422529 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:27:30.422529 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:27:30.422529 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:27:30.422529 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:27:30.422529 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:27:30.422529 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 16:27:30.422529 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 16:27:30.422529 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 16:27:30.423434 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 16:27:30.423434 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:27:30.423434 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:27:30.423434 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:27:30.423434 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:27:30.423434 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:27:30.423434 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:27:30.423434 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:27:30.423434 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application with Lock( Aug 09 16:27:30.423434 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:27:30.423434 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:27:30.423434 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:27:30.423434 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:27:30.423434 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:27:30.423434 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:27:30.423434 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:27:30.423434 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:27:30.424301 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 16:27:30.424301 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 16:27:30.424301 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 16:27:30.424301 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 16:27:30.424301 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 16:27:30.424301 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 16:27:30.424301 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 16:27:30.424301 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Aug 09 16:27:30.424301 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 350/691] 10.222.0.104 () {56 vars in 1116 bytes} [Tue Aug 9 16:27:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 16:27:30.432079 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de71ad1-ce3b-4439-9914-de48a365d65f None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:30.439109 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5204b18d-8729-43d1-acb1-4def6e8467b9 None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:30.482376 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631b56d1-5d65-40c0-b2ac-47678cc7a055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:30.483002 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631b56d1-5d65-40c0-b2ac-47678cc7a055 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:30.483254 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631b56d1-5d65-40c0-b2ac-47678cc7a055 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:30.483525 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631b56d1-5d65-40c0-b2ac-47678cc7a055 None admin] PATH_INFO: `/v3/services` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:30.484146 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631b56d1-5d65-40c0-b2ac-47678cc7a055 None admin] RBAC: Adding query filter params (name=image) {{(pid=87276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:27:30.484449 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631b56d1-5d65-40c0-b2ac-47678cc7a055 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:30.485802 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631b56d1-5d65-40c0-b2ac-47678cc7a055 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:30.494407 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 342/692] 10.222.0.104 () {56 vars in 1113 bytes} [Tue Aug 9 16:27:30 2022] GET /identity/v3/services?name=image => generated 123 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:27:30.497431 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631b56d1-5d65-40c0-b2ac-47678cc7a055 None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:30.552147 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:30.562396 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de71ad1-ce3b-4439-9914-de48a365d65f None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:30.610985 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe6f608-ccc0-4c93-9873-7c4c2a9d1495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:30.612449 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe6f608-ccc0-4c93-9873-7c4c2a9d1495 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:30.613373 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe6f608-ccc0-4c93-9873-7c4c2a9d1495 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:30.613853 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe6f608-ccc0-4c93-9873-7c4c2a9d1495 None admin] PATH_INFO: `/v3/projects` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:30.615072 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe6f608-ccc0-4c93-9873-7c4c2a9d1495 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:27:30.615644 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe6f608-ccc0-4c93-9873-7c4c2a9d1495 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:30.618052 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe6f608-ccc0-4c93-9873-7c4c2a9d1495 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:30.625834 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631b56d1-5d65-40c0-b2ac-47678cc7a055 None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:30.634174 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 351/693] 10.222.0.104 () {56 vars in 1153 bytes} [Tue Aug 9 16:27:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:27:30.641336 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe6f608-ccc0-4c93-9873-7c4c2a9d1495 None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:30.664952 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:30.669684 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3970bcba-a8f5-43ca-87a1-07115ed93650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:30.670350 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3970bcba-a8f5-43ca-87a1-07115ed93650 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:30.670622 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3970bcba-a8f5-43ca-87a1-07115ed93650 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:30.670887 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3970bcba-a8f5-43ca-87a1-07115ed93650 None admin] PATH_INFO: `/v3/services` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:30.671565 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3970bcba-a8f5-43ca-87a1-07115ed93650 None admin] RBAC: Adding query filter params (type=image) {{(pid=87276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:27:30.671870 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3970bcba-a8f5-43ca-87a1-07115ed93650 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:30.674111 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3970bcba-a8f5-43ca-87a1-07115ed93650 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:30.685290 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 343/694] 10.222.0.104 () {56 vars in 1113 bytes} [Tue Aug 9 16:27:30 2022] GET /identity/v3/services?type=image => generated 352 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 16:27:30.688038 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3970bcba-a8f5-43ca-87a1-07115ed93650 None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:30.786353 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe6f608-ccc0-4c93-9873-7c4c2a9d1495 None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:30.813270 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3970bcba-a8f5-43ca-87a1-07115ed93650 None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:30.815760 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:30.832490 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd3ff8e-00b2-4932-8cfe-e469761b607b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:30.833791 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd3ff8e-00b2-4932-8cfe-e469761b607b None admin] REQUEST_METHOD: `PUT` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:30.834441 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd3ff8e-00b2-4932-8cfe-e469761b607b None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:30.834945 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd3ff8e-00b2-4932-8cfe-e469761b607b None admin] PATH_INFO: `/v3/projects/63557f0ff1ce4ae49899b4627bafd94e/users/b4c33c3fc318484d9cdfae778d23f06a/roles/c0143e35c1344a39a931bbb6bcd5acdc` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:30.837352 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd3ff8e-00b2-4932-8cfe-e469761b607b None admin] RBAC: Authorizing `identity:create_grant(project_id=63557f0ff1ce4ae49899b4627bafd94e, user_id=b4c33c3fc318484d9cdfae778d23f06a, role_id=c0143e35c1344a39a931bbb6bcd5acdc)` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:30.839575 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd3ff8e-00b2-4932-8cfe-e469761b607b None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:30.855895 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d78e20-813c-42db-adbe-05cad3a95252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:30.856247 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 352/695] 10.222.0.104 () {58 vars in 1444 bytes} [Tue Aug 9 16:27:30 2022] PUT /identity/v3/projects/63557f0ff1ce4ae49899b4627bafd94e/users/b4c33c3fc318484d9cdfae778d23f06a/roles/c0143e35c1344a39a931bbb6bcd5acdc => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 16:27:30.856375 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d78e20-813c-42db-adbe-05cad3a95252 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:30.856623 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d78e20-813c-42db-adbe-05cad3a95252 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:30.856893 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d78e20-813c-42db-adbe-05cad3a95252 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:30.862753 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d78e20-813c-42db-adbe-05cad3a95252 None admin] RBAC: Adding query filter params (interface=public, service_id=c03ff8b3a0a54bc48159d89e04529cc0, region_id=RegionOne) {{(pid=87276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:27:30.870276 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d78e20-813c-42db-adbe-05cad3a95252 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:30.870276 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d78e20-813c-42db-adbe-05cad3a95252 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:30.878188 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 344/696] 10.222.0.104 () {56 vars in 1256 bytes} [Tue Aug 9 16:27:30 2022] GET /identity/v3/endpoints?service_id=c03ff8b3a0a54bc48159d89e04529cc0&interface=public®ion_id=RegionOne => generated 195 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:27:30.883607 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd3ff8e-00b2-4932-8cfe-e469761b607b None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:30.972609 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:30.999387 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd3ff8e-00b2-4932-8cfe-e469761b607b None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:31.036685 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dff8eb-b358-49b1-a654-0bb24dd5bbea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:31.037302 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dff8eb-b358-49b1-a654-0bb24dd5bbea None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:31.037576 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dff8eb-b358-49b1-a654-0bb24dd5bbea None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:31.037845 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dff8eb-b358-49b1-a654-0bb24dd5bbea None admin] PATH_INFO: `/v3/services` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:31.038492 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dff8eb-b358-49b1-a654-0bb24dd5bbea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:31.039991 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dff8eb-b358-49b1-a654-0bb24dd5bbea None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:31.046896 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 353/697] 10.222.0.104 () {56 vars in 1092 bytes} [Tue Aug 9 16:27:30 2022] GET /identity/v3/services => generated 1007 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 16:27:31.448155 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e349433e-106d-4a31-b39d-342037f50236 None None] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:31.448543 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e349433e-106d-4a31-b39d-342037f50236 None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:31.448721 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e349433e-106d-4a31-b39d-342037f50236 None None] PATH_INFO: `/` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:31.450316 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 345/698] 10.222.0.104 () {54 vars in 932 bytes} [Tue Aug 9 16:27:31 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:27:31.455421 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc212ae-27e4-40b4-9524-c46e0c174952 None None] REQUEST_METHOD: `POST` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:31.455711 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc212ae-27e4-40b4-9524-c46e0c174952 None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:31.455983 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc212ae-27e4-40b4-9524-c46e0c174952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:31.474705 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.auth.core [None req-cdc212ae-27e4-40b4-9524-c46e0c174952 None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:27:31.475910 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.fernet_utils [None req-cdc212ae-27e4-40b4-9524-c46e0c174952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:27:31.545871 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 354/699] 10.222.0.104 () {58 vars in 1029 bytes} [Tue Aug 9 16:27:31 2022] POST /identity/v3/auth/tokens => generated 1099 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 16:27:31.569474 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e349433e-106d-4a31-b39d-342037f50236 None None] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:31.681207 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e349433e-106d-4a31-b39d-342037f50236 None None] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:31.717032 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e24cb3-2054-44bf-9640-0a9b34937e95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:31.718040 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e24cb3-2054-44bf-9640-0a9b34937e95 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:31.718534 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e24cb3-2054-44bf-9640-0a9b34937e95 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:31.719010 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e24cb3-2054-44bf-9640-0a9b34937e95 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:31.719778 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e24cb3-2054-44bf-9640-0a9b34937e95 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:31.721335 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e24cb3-2054-44bf-9640-0a9b34937e95 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:31.730722 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application [None req-61e24cb3-2054-44bf-9640-0a9b34937e95 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 09 16:27:31.730722 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:27:31.730722 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 16:27:31.730722 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 16:27:31.730722 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 16:27:31.730722 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 16:27:31.730722 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 16:27:31.730722 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 16:27:31.730722 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 09 16:27:31.730722 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Aug 09 16:27:31.730722 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 16:27:31.730722 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Aug 09 16:27:31.730722 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:27:31.730722 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:27:31.730722 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:27:31.730722 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:27:31.730722 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:27:31.731706 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:27:31.731706 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:27:31.731706 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:27:31.731706 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:27:31.731706 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:27:31.731706 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:27:31.731706 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 16:27:31.731706 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 16:27:31.731706 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 16:27:31.731706 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 16:27:31.731706 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:27:31.731706 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:27:31.731706 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:27:31.731706 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:27:31.731706 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:27:31.731706 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:27:31.732554 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:27:31.732554 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application with Lock( Aug 09 16:27:31.732554 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:27:31.732554 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:27:31.732554 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:27:31.732554 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:27:31.732554 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:27:31.732554 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:27:31.732554 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:27:31.732554 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:27:31.732554 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 16:27:31.732554 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 16:27:31.732554 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 09 16:27:31.732554 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Aug 09 16:27:31.735272 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 346/700] 10.222.0.104 () {56 vars in 1134 bytes} [Tue Aug 9 16:27:31 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 16:27:31.742986 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc212ae-27e4-40b4-9524-c46e0c174952 None None] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:31.780374 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012ee432-cdf0-4672-9006-c52b08c9dec3 None None] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:31.780693 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012ee432-cdf0-4672-9006-c52b08c9dec3 None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:31.780921 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012ee432-cdf0-4672-9006-c52b08c9dec3 None None] PATH_INFO: `/` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:31.786590 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 347/701] 10.222.0.104 () {54 vars in 932 bytes} [Tue Aug 9 16:27:31 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:27:31.788680 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7857c308-e6c2-4a69-a517-3da61c2a5a9c None None] REQUEST_METHOD: `POST` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:31.788680 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7857c308-e6c2-4a69-a517-3da61c2a5a9c None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:31.788680 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7857c308-e6c2-4a69-a517-3da61c2a5a9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:31.808151 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.auth.core [None req-7857c308-e6c2-4a69-a517-3da61c2a5a9c None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:27:31.809561 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.fernet_utils [None req-7857c308-e6c2-4a69-a517-3da61c2a5a9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:27:31.828421 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:31.845173 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:31.865764 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc212ae-27e4-40b4-9524-c46e0c174952 None None] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:31.903226 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff91578c-efb9-4469-904f-9816aca0256c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:31.904170 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff91578c-efb9-4469-904f-9816aca0256c None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:31.904672 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff91578c-efb9-4469-904f-9816aca0256c None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:31.905169 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff91578c-efb9-4469-904f-9816aca0256c None admin] PATH_INFO: `/v3/services` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:31.906004 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 348/702] 10.222.0.104 () {58 vars in 1029 bytes} [Tue Aug 9 16:27:31 2022] POST /identity/v3/auth/tokens => generated 1099 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 09 16:27:31.906213 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff91578c-efb9-4469-904f-9816aca0256c None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=87275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:27:31.906715 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff91578c-efb9-4469-904f-9816aca0256c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:31.908272 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff91578c-efb9-4469-904f-9816aca0256c None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:31.913688 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 355/703] 10.222.0.104 () {56 vars in 1129 bytes} [Tue Aug 9 16:27:31 2022] GET /identity/v3/services?name=block-storage => generated 131 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:27:31.919572 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7857c308-e6c2-4a69-a517-3da61c2a5a9c None None] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:31.927384 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff91578c-efb9-4469-904f-9816aca0256c None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:32.033600 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7857c308-e6c2-4a69-a517-3da61c2a5a9c None None] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:32.037382 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff91578c-efb9-4469-904f-9816aca0256c None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:32.070415 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79d7f2e-4183-4ab2-824c-665fcef97931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:32.071025 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79d7f2e-4183-4ab2-824c-665fcef97931 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:32.071329 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79d7f2e-4183-4ab2-824c-665fcef97931 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:32.071569 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79d7f2e-4183-4ab2-824c-665fcef97931 None admin] PATH_INFO: `/v3/services` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:32.072759 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79d7f2e-4183-4ab2-824c-665fcef97931 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=87276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:27:32.073069 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79d7f2e-4183-4ab2-824c-665fcef97931 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:32.073866 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae23717-d1e3-4d16-a61b-440dc4172503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:32.074476 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79d7f2e-4183-4ab2-824c-665fcef97931 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:32.074586 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae23717-d1e3-4d16-a61b-440dc4172503 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:32.074806 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae23717-d1e3-4d16-a61b-440dc4172503 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:32.075162 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae23717-d1e3-4d16-a61b-440dc4172503 None admin] PATH_INFO: `/v3/services/network` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:32.075754 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae23717-d1e3-4d16-a61b-440dc4172503 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:32.077103 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae23717-d1e3-4d16-a61b-440dc4172503 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:32.079401 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:32.080925 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 349/704] 10.222.0.104 () {56 vars in 1129 bytes} [Tue Aug 9 16:27:31 2022] GET /identity/v3/services?type=block-storage => generated 369 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:27:32.085856 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79d7f2e-4183-4ab2-824c-665fcef97931 None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:32.093620 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application [None req-5ae23717-d1e3-4d16-a61b-440dc4172503 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 09 16:27:32.093620 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:27:32.093620 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 16:27:32.093620 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 16:27:32.093620 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 16:27:32.093620 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 16:27:32.093620 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 16:27:32.093620 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 16:27:32.093620 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 09 16:27:32.093620 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Aug 09 16:27:32.093620 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 16:27:32.093620 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Aug 09 16:27:32.093620 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:27:32.093620 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:27:32.093620 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:27:32.093620 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:27:32.093620 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:27:32.094698 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:27:32.094698 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:27:32.094698 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:27:32.094698 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:27:32.094698 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:27:32.094698 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:27:32.094698 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 16:27:32.094698 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 16:27:32.094698 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 16:27:32.094698 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 16:27:32.094698 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:27:32.094698 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:27:32.094698 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:27:32.094698 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:27:32.094698 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:27:32.094698 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:27:32.095624 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:27:32.095624 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application with Lock( Aug 09 16:27:32.095624 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:27:32.095624 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:27:32.095624 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:27:32.095624 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:27:32.095624 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:27:32.095624 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:27:32.095624 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:27:32.095624 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:27:32.095624 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 16:27:32.095624 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 16:27:32.095624 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 09 16:27:32.095624 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Aug 09 16:27:32.100347 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 356/705] 10.222.0.104 () {56 vars in 1116 bytes} [Tue Aug 9 16:27:31 2022] GET /identity/v3/services/network => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 16:27:32.101763 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae23717-d1e3-4d16-a61b-440dc4172503 None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:32.126335 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:32.213704 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79d7f2e-4183-4ab2-824c-665fcef97931 None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:32.220556 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae23717-d1e3-4d16-a61b-440dc4172503 None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:32.252653 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b40432-7408-4864-976b-fea8eac87220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:32.253647 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b40432-7408-4864-976b-fea8eac87220 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:32.254138 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b40432-7408-4864-976b-fea8eac87220 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:32.254600 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b40432-7408-4864-976b-fea8eac87220 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:32.255476 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b40432-7408-4864-976b-fea8eac87220 None admin] RBAC: Adding query filter params (interface=public, service_id=d6898a45b5c244cea3360eb5c096951a, region_id=RegionOne) {{(pid=87276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:27:32.255973 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b40432-7408-4864-976b-fea8eac87220 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:32.256633 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e00513f-e70a-45ac-b579-cf0c9ac2cdd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:32.257384 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e00513f-e70a-45ac-b579-cf0c9ac2cdd1 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:32.257724 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e00513f-e70a-45ac-b579-cf0c9ac2cdd1 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:32.258087 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e00513f-e70a-45ac-b579-cf0c9ac2cdd1 None admin] PATH_INFO: `/v3/services` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:32.258451 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b40432-7408-4864-976b-fea8eac87220 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:32.258835 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e00513f-e70a-45ac-b579-cf0c9ac2cdd1 None admin] RBAC: Adding query filter params (name=network) {{(pid=87275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:27:32.259851 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e00513f-e70a-45ac-b579-cf0c9ac2cdd1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:32.261279 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e00513f-e70a-45ac-b579-cf0c9ac2cdd1 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:32.265686 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 350/706] 10.222.0.104 () {56 vars in 1256 bytes} [Tue Aug 9 16:27:32 2022] GET /identity/v3/endpoints?service_id=d6898a45b5c244cea3360eb5c096951a&interface=public®ion_id=RegionOne => generated 195 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:27:32.271472 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 357/707] 10.222.0.104 () {56 vars in 1117 bytes} [Tue Aug 9 16:27:32 2022] GET /identity/v3/services?name=network => generated 125 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 16:27:32.271763 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b40432-7408-4864-976b-fea8eac87220 None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:32.276862 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e00513f-e70a-45ac-b579-cf0c9ac2cdd1 None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:32.357163 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:32.390679 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:32.403108 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b40432-7408-4864-976b-fea8eac87220 None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:32.414113 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e00513f-e70a-45ac-b579-cf0c9ac2cdd1 None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:32.447500 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a846e05-be6c-4ecc-878d-8eead2578030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:32.448259 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a846e05-be6c-4ecc-878d-8eead2578030 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:32.448536 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a846e05-be6c-4ecc-878d-8eead2578030 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:32.448800 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a846e05-be6c-4ecc-878d-8eead2578030 None admin] PATH_INFO: `/v3/services` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:32.449700 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a846e05-be6c-4ecc-878d-8eead2578030 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:32.451444 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a846e05-be6c-4ecc-878d-8eead2578030 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:32.458508 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa386f99-1e9d-45cd-a9a7-0f266edc22ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:32.459574 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa386f99-1e9d-45cd-a9a7-0f266edc22ba None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:32.460083 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa386f99-1e9d-45cd-a9a7-0f266edc22ba None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:32.460651 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa386f99-1e9d-45cd-a9a7-0f266edc22ba None admin] PATH_INFO: `/v3/services` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:32.461502 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa386f99-1e9d-45cd-a9a7-0f266edc22ba None admin] RBAC: Adding query filter params (type=network) {{(pid=87275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:27:32.462102 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa386f99-1e9d-45cd-a9a7-0f266edc22ba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:32.463747 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa386f99-1e9d-45cd-a9a7-0f266edc22ba None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:32.466018 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 351/708] 10.222.0.104 () {56 vars in 1092 bytes} [Tue Aug 9 16:27:32 2022] GET /identity/v3/services => generated 1007 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 16:27:32.470711 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 358/709] 10.222.0.104 () {56 vars in 1117 bytes} [Tue Aug 9 16:27:32 2022] GET /identity/v3/services?type=network => generated 352 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 16:27:32.479636 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a846e05-be6c-4ecc-878d-8eead2578030 None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:32.596895 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a846e05-be6c-4ecc-878d-8eead2578030 None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:32.637658 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e09da7-092b-42eb-a007-13f9e3a14302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:32.638683 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e09da7-092b-42eb-a007-13f9e3a14302 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:32.639181 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e09da7-092b-42eb-a007-13f9e3a14302 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:32.639651 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e09da7-092b-42eb-a007-13f9e3a14302 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:32.640577 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e09da7-092b-42eb-a007-13f9e3a14302 None admin] RBAC: Adding query filter params (interface=public, service_id=8c857594cb394685b72c2b4d86f4de4d, region_id=RegionOne) {{(pid=87276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:27:32.641808 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e09da7-092b-42eb-a007-13f9e3a14302 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:32.643442 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e09da7-092b-42eb-a007-13f9e3a14302 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:32.650729 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 352/710] 10.222.0.104 () {56 vars in 1256 bytes} [Tue Aug 9 16:27:32 2022] GET /identity/v3/endpoints?service_id=8c857594cb394685b72c2b4d86f4de4d&interface=public®ion_id=RegionOne => generated 195 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:27:32.657207 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa386f99-1e9d-45cd-a9a7-0f266edc22ba None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:32.764280 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa386f99-1e9d-45cd-a9a7-0f266edc22ba None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:32.794455 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:32.805623 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7abec24-1a55-49d9-83ff-b47417b518e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:32.807117 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7abec24-1a55-49d9-83ff-b47417b518e0 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:32.807600 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7abec24-1a55-49d9-83ff-b47417b518e0 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:32.808072 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7abec24-1a55-49d9-83ff-b47417b518e0 None admin] PATH_INFO: `/v3/services` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:32.808944 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7abec24-1a55-49d9-83ff-b47417b518e0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:32.810584 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7abec24-1a55-49d9-83ff-b47417b518e0 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:32.817173 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 359/711] 10.222.0.104 () {56 vars in 1092 bytes} [Tue Aug 9 16:27:32 2022] GET /identity/v3/services => generated 1007 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 16:27:33.291507 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2181312a-1e6a-4f0d-8cc0-a5b4b9a87fd2 None None] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:33.291920 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2181312a-1e6a-4f0d-8cc0-a5b4b9a87fd2 None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:33.292102 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2181312a-1e6a-4f0d-8cc0-a5b4b9a87fd2 None None] PATH_INFO: `/` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:33.293688 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 353/712] 10.222.0.104 () {54 vars in 932 bytes} [Tue Aug 9 16:27:33 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:27:33.299007 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2130a867-4b3a-4692-b598-f9c1c744c115 None None] REQUEST_METHOD: `POST` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:33.299290 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2130a867-4b3a-4692-b598-f9c1c744c115 None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:33.299567 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2130a867-4b3a-4692-b598-f9c1c744c115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:33.318610 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.auth.core [None req-2130a867-4b3a-4692-b598-f9c1c744c115 None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:27:33.319794 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.fernet_utils [None req-2130a867-4b3a-4692-b598-f9c1c744c115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:27:33.389418 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 360/713] 10.222.0.104 () {58 vars in 1029 bytes} [Tue Aug 9 16:27:33 2022] POST /identity/v3/auth/tokens => generated 1099 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 16:27:33.413170 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2181312a-1e6a-4f0d-8cc0-a5b4b9a87fd2 None None] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:33.434821 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:33.489839 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bafc63-aad5-476d-8222-4f6fa645ed71 None None] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:33.490170 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bafc63-aad5-476d-8222-4f6fa645ed71 None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:33.490414 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bafc63-aad5-476d-8222-4f6fa645ed71 None None] PATH_INFO: `/` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:33.491998 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 361/714] 10.222.0.104 () {54 vars in 932 bytes} [Tue Aug 9 16:27:33 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 09 16:27:33.499165 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd70071-667e-4d2f-8665-732801886845 None None] REQUEST_METHOD: `POST` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:33.499578 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd70071-667e-4d2f-8665-732801886845 None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:33.499948 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd70071-667e-4d2f-8665-732801886845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:33.518026 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.auth.core [None req-9bd70071-667e-4d2f-8665-732801886845 None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:27:33.519350 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.fernet_utils [None req-9bd70071-667e-4d2f-8665-732801886845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:27:33.527550 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2181312a-1e6a-4f0d-8cc0-a5b4b9a87fd2 None None] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:33.571531 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad511ce5-2b2f-452b-9982-57273df1f14e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:33.572231 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad511ce5-2b2f-452b-9982-57273df1f14e None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:33.572608 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad511ce5-2b2f-452b-9982-57273df1f14e None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:33.572972 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad511ce5-2b2f-452b-9982-57273df1f14e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:33.587696 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad511ce5-2b2f-452b-9982-57273df1f14e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 16:27:33.594632 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application [None req-ad511ce5-2b2f-452b-9982-57273df1f14e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 16:27:33.594632 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:27:33.594632 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:27:33.594632 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:27:33.594632 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:27:33.594632 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:27:33.594632 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:27:33.594632 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:27:33.594632 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:27:33.594632 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:27:33.594632 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:27:33.594632 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:27:33.594632 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 16:27:33.594632 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 16:27:33.594632 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 16:27:33.594632 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 16:27:33.595603 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 16:27:33.595603 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 16:27:33.595603 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 16:27:33.595603 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 16:27:33.595603 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:27:33.595603 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:27:33.595603 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:27:33.595603 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:27:33.595603 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:27:33.595603 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:27:33.595603 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:27:33.595603 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application with Lock( Aug 09 16:27:33.595603 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:27:33.595603 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:27:33.595603 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:27:33.595603 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:27:33.596430 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:27:33.596430 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:27:33.596430 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:27:33.596430 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:27:33.596430 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 16:27:33.596430 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 16:27:33.596430 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 16:27:33.596430 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 16:27:33.596430 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 16:27:33.596430 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 16:27:33.596430 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 16:27:33.596430 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Aug 09 16:27:33.601056 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 354/715] 10.222.0.104 () {56 vars in 1101 bytes} [Tue Aug 9 16:27:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 16:27:33.602200 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad511ce5-2b2f-452b-9982-57273df1f14e None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:33.617937 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 362/716] 10.222.0.104 () {58 vars in 1029 bytes} [Tue Aug 9 16:27:33 2022] POST /identity/v3/auth/tokens => generated 1099 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 09 16:27:33.639438 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd70071-667e-4d2f-8665-732801886845 None None] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:33.704738 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:33.717301 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:33.753990 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad511ce5-2b2f-452b-9982-57273df1f14e None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:33.785499 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd70071-667e-4d2f-8665-732801886845 None None] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:33.809196 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541c4089-0123-41de-be9d-0bf60a3294e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:33.810107 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541c4089-0123-41de-be9d-0bf60a3294e0 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:33.810531 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541c4089-0123-41de-be9d-0bf60a3294e0 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:33.810970 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541c4089-0123-41de-be9d-0bf60a3294e0 None admin] PATH_INFO: `/v3/roles` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:33.812259 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541c4089-0123-41de-be9d-0bf60a3294e0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:27:33.812714 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541c4089-0123-41de-be9d-0bf60a3294e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:33.814814 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541c4089-0123-41de-be9d-0bf60a3294e0 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:33.826012 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 355/717] 10.222.0.104 () {56 vars in 1104 bytes} [Tue Aug 9 16:27:33 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:27:33.830575 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541c4089-0123-41de-be9d-0bf60a3294e0 None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:33.834077 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416d58b5-7f10-49a5-864a-36cfd3dd36a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:33.835329 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416d58b5-7f10-49a5-864a-36cfd3dd36a1 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:33.835329 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416d58b5-7f10-49a5-864a-36cfd3dd36a1 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:33.835329 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416d58b5-7f10-49a5-864a-36cfd3dd36a1 None admin] PATH_INFO: `/v3/services/image` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:33.836147 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416d58b5-7f10-49a5-864a-36cfd3dd36a1 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:33.838138 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416d58b5-7f10-49a5-864a-36cfd3dd36a1 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:33.847162 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application [None req-416d58b5-7f10-49a5-864a-36cfd3dd36a1 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 09 16:27:33.847162 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:27:33.847162 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 16:27:33.847162 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 16:27:33.847162 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 16:27:33.847162 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 16:27:33.847162 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 16:27:33.847162 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 16:27:33.847162 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 09 16:27:33.847162 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Aug 09 16:27:33.847162 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 16:27:33.847162 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Aug 09 16:27:33.847162 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:27:33.847162 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:27:33.847162 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:27:33.847162 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:27:33.847162 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:27:33.848179 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:27:33.848179 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:27:33.848179 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:27:33.848179 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:27:33.848179 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:27:33.848179 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:27:33.848179 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 16:27:33.848179 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 16:27:33.848179 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 16:27:33.848179 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 16:27:33.848179 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:27:33.848179 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:27:33.848179 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:27:33.848179 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:27:33.848179 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:27:33.848179 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:27:33.849013 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:27:33.849013 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application with Lock( Aug 09 16:27:33.849013 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:27:33.849013 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:27:33.849013 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:27:33.849013 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:27:33.849013 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:27:33.849013 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:27:33.849013 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:27:33.849013 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:27:33.849013 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 16:27:33.849013 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 16:27:33.849013 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 09 16:27:33.849013 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Aug 09 16:27:33.853764 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 363/718] 10.222.0.104 () {56 vars in 1110 bytes} [Tue Aug 9 16:27:33 2022] GET /identity/v3/services/image => generated 86 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 16:27:33.854693 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416d58b5-7f10-49a5-864a-36cfd3dd36a1 None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:33.945995 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541c4089-0123-41de-be9d-0bf60a3294e0 None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:33.955379 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416d58b5-7f10-49a5-864a-36cfd3dd36a1 None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:33.970674 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:33.989440 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f8597d-9f18-4ce9-b4f0-6359ae893f03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:33.990379 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f8597d-9f18-4ce9-b4f0-6359ae893f03 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:33.990837 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f8597d-9f18-4ce9-b4f0-6359ae893f03 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:33.991287 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f8597d-9f18-4ce9-b4f0-6359ae893f03 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:33.992227 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea3a02d-7250-48c3-9c96-29af657d38ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:33.992951 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea3a02d-7250-48c3-9c96-29af657d38ba None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:33.993335 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea3a02d-7250-48c3-9c96-29af657d38ba None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:33.993693 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea3a02d-7250-48c3-9c96-29af657d38ba None admin] PATH_INFO: `/v3/services` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:33.994421 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea3a02d-7250-48c3-9c96-29af657d38ba None admin] RBAC: Adding query filter params (name=image) {{(pid=87275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:27:33.994791 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea3a02d-7250-48c3-9c96-29af657d38ba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:33.996233 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea3a02d-7250-48c3-9c96-29af657d38ba None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:34.005631 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 364/719] 10.222.0.104 () {56 vars in 1113 bytes} [Tue Aug 9 16:27:33 2022] GET /identity/v3/services?name=image => generated 123 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:27:34.005819 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:34.006670 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f8597d-9f18-4ce9-b4f0-6359ae893f03 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:34.008081 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea3a02d-7250-48c3-9c96-29af657d38ba None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:34.008316 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f8597d-9f18-4ce9-b4f0-6359ae893f03 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:34.026619 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application [None req-22f8597d-9f18-4ce9-b4f0-6359ae893f03 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 16:27:34.026619 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:27:34.026619 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:27:34.026619 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:27:34.026619 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:27:34.026619 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:27:34.026619 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:27:34.026619 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:27:34.026619 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:27:34.026619 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:27:34.026619 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:27:34.026619 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:27:34.026619 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 16:27:34.026619 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 16:27:34.026619 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 16:27:34.026619 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 16:27:34.027625 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:27:34.027625 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:27:34.027625 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:27:34.027625 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:27:34.027625 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:27:34.027625 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:27:34.027625 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:27:34.027625 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application with Lock( Aug 09 16:27:34.027625 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:27:34.027625 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:27:34.027625 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:27:34.027625 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:27:34.027625 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:27:34.027625 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:27:34.027625 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:27:34.027625 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:27:34.027625 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 16:27:34.028917 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 16:27:34.028917 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 16:27:34.028917 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Aug 09 16:27:34.032536 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 356/720] 10.222.0.104 () {56 vars in 1113 bytes} [Tue Aug 9 16:27:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 16:27:34.033566 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f8597d-9f18-4ce9-b4f0-6359ae893f03 None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:34.132522 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea3a02d-7250-48c3-9c96-29af657d38ba None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:34.162807 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f8597d-9f18-4ce9-b4f0-6359ae893f03 None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:34.174080 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96f4ed9-0329-4bad-8b3f-920292cb3ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:34.175056 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96f4ed9-0329-4bad-8b3f-920292cb3ce9 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:34.175536 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96f4ed9-0329-4bad-8b3f-920292cb3ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:34.176008 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96f4ed9-0329-4bad-8b3f-920292cb3ce9 None admin] PATH_INFO: `/v3/services` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:34.176843 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96f4ed9-0329-4bad-8b3f-920292cb3ce9 None admin] RBAC: Adding query filter params (type=image) {{(pid=87275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:27:34.177346 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96f4ed9-0329-4bad-8b3f-920292cb3ce9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:34.179148 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96f4ed9-0329-4bad-8b3f-920292cb3ce9 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:34.189376 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 365/721] 10.222.0.104 () {56 vars in 1113 bytes} [Tue Aug 9 16:27:34 2022] GET /identity/v3/services?type=image => generated 352 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 16:27:34.190906 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96f4ed9-0329-4bad-8b3f-920292cb3ce9 None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:34.204966 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283f2863-9c11-4e5d-bfb9-680a13026c22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:34.205583 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283f2863-9c11-4e5d-bfb9-680a13026c22 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:34.205862 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283f2863-9c11-4e5d-bfb9-680a13026c22 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:34.206183 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283f2863-9c11-4e5d-bfb9-680a13026c22 None admin] PATH_INFO: `/v3/domains` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:34.207109 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283f2863-9c11-4e5d-bfb9-680a13026c22 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:27:34.207416 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283f2863-9c11-4e5d-bfb9-680a13026c22 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:34.209131 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283f2863-9c11-4e5d-bfb9-680a13026c22 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:34.231315 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 357/722] 10.222.0.104 () {56 vars in 1114 bytes} [Tue Aug 9 16:27:34 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 16:27:34.232215 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283f2863-9c11-4e5d-bfb9-680a13026c22 None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:34.243419 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:34.300706 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:34.313417 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96f4ed9-0329-4bad-8b3f-920292cb3ce9 None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:34.350255 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d162c7-c5aa-4393-a0e5-b271c7591a1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:34.350870 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d162c7-c5aa-4393-a0e5-b271c7591a1a None admin] REQUEST_METHOD: `POST` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:34.351147 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d162c7-c5aa-4393-a0e5-b271c7591a1a None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:34.351417 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d162c7-c5aa-4393-a0e5-b271c7591a1a None admin] PATH_INFO: `/v3/endpoints` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:34.352342 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d162c7-c5aa-4393-a0e5-b271c7591a1a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:34.353514 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d162c7-c5aa-4393-a0e5-b271c7591a1a None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:34.373533 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283f2863-9c11-4e5d-bfb9-680a13026c22 None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:34.383301 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 366/723] 10.222.0.104 () {60 vars in 1149 bytes} [Tue Aug 9 16:27:34 2022] POST /identity/v3/endpoints => generated 329 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 16:27:34.423960 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d540b40-a4c0-411a-a250-e3810dfedf37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:34.424977 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d540b40-a4c0-411a-a250-e3810dfedf37 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:34.425433 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d540b40-a4c0-411a-a250-e3810dfedf37 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:34.425972 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d540b40-a4c0-411a-a250-e3810dfedf37 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:34.443227 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d540b40-a4c0-411a-a250-e3810dfedf37 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:34.444835 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d540b40-a4c0-411a-a250-e3810dfedf37 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:34.459312 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application [None req-9d540b40-a4c0-411a-a250-e3810dfedf37 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 09 16:27:34.459312 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:27:34.459312 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:27:34.459312 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:27:34.459312 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:27:34.459312 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:27:34.459312 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:27:34.459312 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:27:34.459312 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:27:34.459312 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:27:34.459312 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:27:34.459312 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:27:34.459312 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 16:27:34.459312 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 16:27:34.459312 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 16:27:34.459312 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 16:27:34.460336 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:27:34.460336 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:27:34.460336 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 16:27:34.460336 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 16:27:34.460336 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 16:27:34.460336 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 16:27:34.460336 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:27:34.460336 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:27:34.460336 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:27:34.460336 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:27:34.460336 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:27:34.460336 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application with Lock( Aug 09 16:27:34.460336 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:27:34.460336 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:27:34.460336 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:27:34.460336 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:27:34.460336 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:27:34.460336 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:27:34.461259 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:27:34.461259 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:27:34.461259 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 16:27:34.461259 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 16:27:34.461259 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 16:27:34.461259 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 16:27:34.461259 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 16:27:34.461259 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 16:27:34.461259 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 09 16:27:34.461259 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Aug 09 16:27:34.461259 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 358/724] 10.222.0.104 () {56 vars in 1098 bytes} [Tue Aug 9 16:27:34 2022] GET /identity/v3/users/nova => generated 82 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 16:27:34.469036 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d162c7-c5aa-4393-a0e5-b271c7591a1a None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:34.588125 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:34.593511 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d162c7-c5aa-4393-a0e5-b271c7591a1a None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:34.631611 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de26a0b-c357-473a-9e3c-6ec8f20da6c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:34.632270 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de26a0b-c357-473a-9e3c-6ec8f20da6c8 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:34.632546 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de26a0b-c357-473a-9e3c-6ec8f20da6c8 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:34.632816 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de26a0b-c357-473a-9e3c-6ec8f20da6c8 None admin] PATH_INFO: `/v3/users` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:34.633592 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de26a0b-c357-473a-9e3c-6ec8f20da6c8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:27:34.634483 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de26a0b-c357-473a-9e3c-6ec8f20da6c8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:34.636343 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de26a0b-c357-473a-9e3c-6ec8f20da6c8 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:34.654828 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 367/725] 10.222.0.104 () {56 vars in 1138 bytes} [Tue Aug 9 16:27:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:27:34.661255 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d540b40-a4c0-411a-a250-e3810dfedf37 None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:34.777505 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d540b40-a4c0-411a-a250-e3810dfedf37 None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:34.785478 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:34.813067 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2f3622-3889-426e-a7cb-17162db8c25d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:34.813678 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2f3622-3889-426e-a7cb-17162db8c25d None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:34.813975 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2f3622-3889-426e-a7cb-17162db8c25d None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:34.814259 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2f3622-3889-426e-a7cb-17162db8c25d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:34.886970 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2f3622-3889-426e-a7cb-17162db8c25d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:34.888368 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2f3622-3889-426e-a7cb-17162db8c25d None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:34.945544 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6354de11-c464-4ca7-861b-16346e5c8414 None None] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:34.946102 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6354de11-c464-4ca7-861b-16346e5c8414 None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:34.946102 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6354de11-c464-4ca7-861b-16346e5c8414 None None] PATH_INFO: `/` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:34.948336 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 368/726] 10.222.0.104 () {54 vars in 932 bytes} [Tue Aug 9 16:27:34 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 09 16:27:34.953683 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c9ca32-47d5-41ba-9022-168d21b8d547 None None] REQUEST_METHOD: `POST` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:34.953999 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c9ca32-47d5-41ba-9022-168d21b8d547 None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:34.954275 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c9ca32-47d5-41ba-9022-168d21b8d547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:34.974644 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.auth.core [None req-d8c9ca32-47d5-41ba-9022-168d21b8d547 None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:27:34.976828 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.fernet_utils [None req-d8c9ca32-47d5-41ba-9022-168d21b8d547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:27:34.999129 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 359/727] 10.222.0.104 () {58 vars in 1287 bytes} [Tue Aug 9 16:27:34 2022] GET /identity/v3/auth/tokens => generated 1249 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 09 16:27:35.005853 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2f3622-3889-426e-a7cb-17162db8c25d None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:35.019925 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:35.078103 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 369/728] 10.222.0.104 () {58 vars in 1029 bytes} [Tue Aug 9 16:27:34 2022] POST /identity/v3/auth/tokens => generated 1249 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 16:27:35.103678 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c9ca32-47d5-41ba-9022-168d21b8d547 None None] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:35.152020 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2f3622-3889-426e-a7cb-17162db8c25d None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:35.199963 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5faccd-49d9-4bf3-8879-b4a8602106f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:35.200701 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5faccd-49d9-4bf3-8879-b4a8602106f9 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:35.201080 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5faccd-49d9-4bf3-8879-b4a8602106f9 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:35.201488 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5faccd-49d9-4bf3-8879-b4a8602106f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:35.215006 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:35.219017 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5faccd-49d9-4bf3-8879-b4a8602106f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:35.221694 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5faccd-49d9-4bf3-8879-b4a8602106f9 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:35.235111 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c9ca32-47d5-41ba-9022-168d21b8d547 None None] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:35.237104 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application [None req-3e5faccd-49d9-4bf3-8879-b4a8602106f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 16:27:35.237104 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:27:35.237104 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:27:35.237104 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:27:35.237104 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:27:35.237104 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:27:35.237104 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:27:35.237104 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:27:35.237104 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:27:35.237104 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:27:35.237104 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:27:35.237104 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:27:35.237104 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 16:27:35.237104 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 16:27:35.237104 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 16:27:35.237104 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 16:27:35.238393 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:27:35.238393 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:27:35.238393 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:27:35.238393 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:27:35.238393 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:27:35.238393 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:27:35.238393 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:27:35.238393 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application with Lock( Aug 09 16:27:35.238393 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:27:35.238393 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:27:35.238393 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:27:35.238393 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:27:35.238393 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:27:35.238393 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:27:35.238393 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:27:35.238393 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:27:35.238393 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 16:27:35.239350 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 16:27:35.239350 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 16:27:35.239350 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Aug 09 16:27:35.239350 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 360/729] 10.222.0.104 () {56 vars in 1113 bytes} [Tue Aug 9 16:27:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 16:27:35.239350 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9818089-e927-4db7-858c-52dde01b26a9 None None] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:35.239656 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9818089-e927-4db7-858c-52dde01b26a9 None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:35.240015 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9818089-e927-4db7-858c-52dde01b26a9 None None] PATH_INFO: `/` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:35.241287 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 361/730] 10.222.0.104 () {54 vars in 932 bytes} [Tue Aug 9 16:27:35 2022] GET /identity => generated 271 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:27:35.247408 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d081d38-98e9-4017-838c-4c401c4969d2 None None] REQUEST_METHOD: `POST` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:35.247690 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d081d38-98e9-4017-838c-4c401c4969d2 None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:35.247960 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d081d38-98e9-4017-838c-4c401c4969d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:35.267177 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.auth.core [None req-5d081d38-98e9-4017-838c-4c401c4969d2 None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:27:35.268356 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.fernet_utils [None req-5d081d38-98e9-4017-838c-4c401c4969d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:27:35.279785 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27955408-5233-4452-96aa-297e16a7dc61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:35.280543 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27955408-5233-4452-96aa-297e16a7dc61 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:35.280743 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27955408-5233-4452-96aa-297e16a7dc61 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:35.281056 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27955408-5233-4452-96aa-297e16a7dc61 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:35.281692 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27955408-5233-4452-96aa-297e16a7dc61 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:35.283010 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27955408-5233-4452-96aa-297e16a7dc61 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:35.292667 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application [None req-27955408-5233-4452-96aa-297e16a7dc61 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 09 16:27:35.292667 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:27:35.292667 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 16:27:35.292667 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 16:27:35.292667 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 16:27:35.292667 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 16:27:35.292667 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 16:27:35.292667 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 16:27:35.292667 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 09 16:27:35.292667 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Aug 09 16:27:35.292667 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 16:27:35.292667 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Aug 09 16:27:35.292667 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:27:35.292667 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:27:35.292667 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:27:35.292667 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:27:35.292667 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:27:35.293716 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:27:35.293716 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:27:35.293716 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:27:35.293716 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:27:35.293716 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:27:35.293716 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:27:35.293716 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 16:27:35.293716 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 16:27:35.293716 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 16:27:35.293716 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 16:27:35.293716 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:27:35.293716 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:27:35.293716 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:27:35.293716 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:27:35.293716 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:27:35.293716 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:27:35.295235 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:27:35.295235 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application with Lock( Aug 09 16:27:35.295235 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:27:35.295235 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:27:35.295235 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:27:35.295235 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:27:35.295235 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:27:35.295235 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:27:35.295235 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:27:35.295235 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:27:35.295235 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 16:27:35.295235 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 16:27:35.295235 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 09 16:27:35.295235 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Aug 09 16:27:35.299576 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 370/731] 10.222.0.104 () {56 vars in 1134 bytes} [Tue Aug 9 16:27:35 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 16:27:35.300483 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27955408-5233-4452-96aa-297e16a7dc61 None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:35.333705 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:35.349953 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 362/732] 10.222.0.104 () {58 vars in 1029 bytes} [Tue Aug 9 16:27:35 2022] POST /identity/v3/auth/tokens => generated 1249 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 09 16:27:35.349953 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d081d38-98e9-4017-838c-4c401c4969d2 None None] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:35.416701 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27955408-5233-4452-96aa-297e16a7dc61 None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:35.452057 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74a44ef-f6ef-4637-8090-e4d71ac06c59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:35.452963 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74a44ef-f6ef-4637-8090-e4d71ac06c59 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:35.453443 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74a44ef-f6ef-4637-8090-e4d71ac06c59 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:35.453967 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74a44ef-f6ef-4637-8090-e4d71ac06c59 None admin] PATH_INFO: `/v3/domains` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:35.454803 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74a44ef-f6ef-4637-8090-e4d71ac06c59 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:27:35.455386 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74a44ef-f6ef-4637-8090-e4d71ac06c59 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:35.456878 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74a44ef-f6ef-4637-8090-e4d71ac06c59 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:35.468624 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d081d38-98e9-4017-838c-4c401c4969d2 None None] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:35.473939 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 371/733] 10.222.0.104 () {56 vars in 1114 bytes} [Tue Aug 9 16:27:35 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:27:35.473939 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74a44ef-f6ef-4637-8090-e4d71ac06c59 None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:35.485493 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:35.511396 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f31c8e1-3b91-41eb-87fc-cc6fafa59c41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:35.512004 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f31c8e1-3b91-41eb-87fc-cc6fafa59c41 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:35.512284 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f31c8e1-3b91-41eb-87fc-cc6fafa59c41 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:35.512558 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f31c8e1-3b91-41eb-87fc-cc6fafa59c41 None admin] PATH_INFO: `/v3/services` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:35.513178 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f31c8e1-3b91-41eb-87fc-cc6fafa59c41 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=87276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:27:35.513478 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f31c8e1-3b91-41eb-87fc-cc6fafa59c41 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:35.514869 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f31c8e1-3b91-41eb-87fc-cc6fafa59c41 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:35.524006 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 363/734] 10.222.0.104 () {56 vars in 1129 bytes} [Tue Aug 9 16:27:35 2022] GET /identity/v3/services?name=block-storage => generated 131 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:27:35.524006 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f31c8e1-3b91-41eb-87fc-cc6fafa59c41 None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:35.582393 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:35.590752 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74a44ef-f6ef-4637-8090-e4d71ac06c59 None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:35.629144 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9886f50c-8538-407e-8199-9a7b2189b2f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:35.629887 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9886f50c-8538-407e-8199-9a7b2189b2f2 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:35.630194 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9886f50c-8538-407e-8199-9a7b2189b2f2 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:35.630465 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9886f50c-8538-407e-8199-9a7b2189b2f2 None admin] PATH_INFO: `/v3/services/network` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:35.631048 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9886f50c-8538-407e-8199-9a7b2189b2f2 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:35.632409 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9886f50c-8538-407e-8199-9a7b2189b2f2 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:35.635280 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f31c8e1-3b91-41eb-87fc-cc6fafa59c41 None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:35.642027 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application [None req-9886f50c-8538-407e-8199-9a7b2189b2f2 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 09 16:27:35.642027 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:27:35.642027 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 16:27:35.642027 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 16:27:35.642027 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 16:27:35.642027 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 16:27:35.642027 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 16:27:35.642027 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 16:27:35.642027 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 09 16:27:35.642027 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Aug 09 16:27:35.642027 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 16:27:35.642027 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Aug 09 16:27:35.642027 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:27:35.642027 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:27:35.642027 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:27:35.642027 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:27:35.642027 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:27:35.643101 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:27:35.643101 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:27:35.643101 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:27:35.643101 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:27:35.643101 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:27:35.643101 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:27:35.643101 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 16:27:35.643101 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 16:27:35.643101 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 16:27:35.643101 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 16:27:35.643101 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:27:35.643101 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:27:35.643101 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:27:35.643101 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:27:35.643101 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:27:35.643101 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:27:35.647038 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:27:35.647038 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application with Lock( Aug 09 16:27:35.647038 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:27:35.647038 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:27:35.647038 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:27:35.647038 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:27:35.647038 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:27:35.647038 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:27:35.647038 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:27:35.647038 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:27:35.647038 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 16:27:35.647038 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 16:27:35.647038 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 09 16:27:35.647038 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Aug 09 16:27:35.647038 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 372/735] 10.222.0.104 () {56 vars in 1116 bytes} [Tue Aug 9 16:27:35 2022] GET /identity/v3/services/network => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 16:27:35.647860 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9886f50c-8538-407e-8199-9a7b2189b2f2 None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:35.683709 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef5aa2e-6794-4240-bc16-783b0c2a72a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:35.684266 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef5aa2e-6794-4240-bc16-783b0c2a72a0 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:35.684527 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef5aa2e-6794-4240-bc16-783b0c2a72a0 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:35.684799 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef5aa2e-6794-4240-bc16-783b0c2a72a0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:35.696053 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef5aa2e-6794-4240-bc16-783b0c2a72a0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:35.697308 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef5aa2e-6794-4240-bc16-783b0c2a72a0 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:35.709268 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application [None req-4ef5aa2e-6794-4240-bc16-783b0c2a72a0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 16:27:35.709268 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:27:35.709268 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:27:35.709268 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:27:35.709268 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:27:35.709268 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:27:35.709268 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:27:35.709268 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:27:35.709268 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:27:35.709268 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:27:35.709268 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:27:35.709268 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:27:35.709268 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 16:27:35.709268 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 16:27:35.709268 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 16:27:35.710394 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 16:27:35.710394 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:27:35.710394 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:27:35.710394 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:27:35.710394 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:27:35.710394 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:27:35.710394 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:27:35.710394 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:27:35.710394 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application with Lock( Aug 09 16:27:35.710394 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:27:35.710394 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:27:35.710394 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:27:35.710394 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:27:35.710394 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:27:35.710394 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:27:35.710394 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:27:35.710394 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:27:35.711297 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 16:27:35.711297 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 16:27:35.711297 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 16:27:35.711297 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 16:27:35.711297 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 16:27:35.711297 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 16:27:35.711297 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 16:27:35.711297 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Aug 09 16:27:35.711297 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 364/736] 10.222.0.104 () {56 vars in 1116 bytes} [Tue Aug 9 16:27:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 16:27:35.711297 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef5aa2e-6794-4240-bc16-783b0c2a72a0 None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:35.738971 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:35.771599 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9886f50c-8538-407e-8199-9a7b2189b2f2 None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:35.814255 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3286c375-f9a2-4e39-887c-4a2cd72097cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:35.814860 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3286c375-f9a2-4e39-887c-4a2cd72097cd None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:35.815138 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3286c375-f9a2-4e39-887c-4a2cd72097cd None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:35.815465 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3286c375-f9a2-4e39-887c-4a2cd72097cd None admin] PATH_INFO: `/v3/services` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:35.816094 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3286c375-f9a2-4e39-887c-4a2cd72097cd None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=87275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:27:35.816560 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3286c375-f9a2-4e39-887c-4a2cd72097cd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:35.817827 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3286c375-f9a2-4e39-887c-4a2cd72097cd None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:35.822049 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef5aa2e-6794-4240-bc16-783b0c2a72a0 None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:35.822960 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 373/737] 10.222.0.104 () {56 vars in 1129 bytes} [Tue Aug 9 16:27:35 2022] GET /identity/v3/services?type=block-storage => generated 369 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:27:35.823576 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3286c375-f9a2-4e39-887c-4a2cd72097cd None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:35.842266 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:35.863162 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70042cf8-3c2c-4461-a341-1cfc699fda5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:35.863851 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70042cf8-3c2c-4461-a341-1cfc699fda5a None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:35.864198 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70042cf8-3c2c-4461-a341-1cfc699fda5a None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:35.864568 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70042cf8-3c2c-4461-a341-1cfc699fda5a None admin] PATH_INFO: `/v3/services` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:35.865223 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70042cf8-3c2c-4461-a341-1cfc699fda5a None admin] RBAC: Adding query filter params (name=network) {{(pid=87276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:27:35.865612 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70042cf8-3c2c-4461-a341-1cfc699fda5a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:35.867081 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70042cf8-3c2c-4461-a341-1cfc699fda5a None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:35.872143 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 365/738] 10.222.0.104 () {56 vars in 1117 bytes} [Tue Aug 9 16:27:35 2022] GET /identity/v3/services?name=network => generated 125 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:27:35.872742 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70042cf8-3c2c-4461-a341-1cfc699fda5a None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:35.936645 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3286c375-f9a2-4e39-887c-4a2cd72097cd None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:35.972159 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70042cf8-3c2c-4461-a341-1cfc699fda5a None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:35.972351 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4379bbe6-7c0f-4401-9c8e-786a3a9931c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:35.972903 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4379bbe6-7c0f-4401-9c8e-786a3a9931c2 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:35.973168 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4379bbe6-7c0f-4401-9c8e-786a3a9931c2 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:35.973555 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4379bbe6-7c0f-4401-9c8e-786a3a9931c2 None admin] PATH_INFO: `/v3/projects` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:35.974393 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4379bbe6-7c0f-4401-9c8e-786a3a9931c2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:27:35.974700 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4379bbe6-7c0f-4401-9c8e-786a3a9931c2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:35.976151 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4379bbe6-7c0f-4401-9c8e-786a3a9931c2 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:35.983999 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:35.990181 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 374/739] 10.222.0.104 () {56 vars in 1153 bytes} [Tue Aug 9 16:27:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:27:35.991249 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4379bbe6-7c0f-4401-9c8e-786a3a9931c2 None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:36.014804 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea66190-b39c-446f-9e2e-8de42860b5a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:36.015678 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea66190-b39c-446f-9e2e-8de42860b5a5 None admin] REQUEST_METHOD: `POST` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:36.016102 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea66190-b39c-446f-9e2e-8de42860b5a5 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:36.016546 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea66190-b39c-446f-9e2e-8de42860b5a5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:36.017361 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea66190-b39c-446f-9e2e-8de42860b5a5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:36.018954 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea66190-b39c-446f-9e2e-8de42860b5a5 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:36.043954 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 366/740] 10.222.0.104 () {60 vars in 1149 bytes} [Tue Aug 9 16:27:35 2022] POST /identity/v3/endpoints => generated 348 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 16:27:36.044972 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea66190-b39c-446f-9e2e-8de42860b5a5 None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:36.100559 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:36.128820 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4379bbe6-7c0f-4401-9c8e-786a3a9931c2 None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:36.193403 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea66190-b39c-446f-9e2e-8de42860b5a5 None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:36.198021 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69858626-6011-4e6f-95ad-ebb7ca2326bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:36.198842 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69858626-6011-4e6f-95ad-ebb7ca2326bb None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:36.199223 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69858626-6011-4e6f-95ad-ebb7ca2326bb None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:36.199596 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69858626-6011-4e6f-95ad-ebb7ca2326bb None admin] PATH_INFO: `/v3/services` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:36.200358 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69858626-6011-4e6f-95ad-ebb7ca2326bb None admin] RBAC: Adding query filter params (type=network) {{(pid=87275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:27:36.200767 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69858626-6011-4e6f-95ad-ebb7ca2326bb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:36.202442 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69858626-6011-4e6f-95ad-ebb7ca2326bb None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:36.210789 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 375/741] 10.222.0.104 () {56 vars in 1117 bytes} [Tue Aug 9 16:27:35 2022] GET /identity/v3/services?type=network => generated 352 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:27:36.219310 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69858626-6011-4e6f-95ad-ebb7ca2326bb None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:36.242557 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba1084a-b421-4736-bcd7-5c7b7587951c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:36.243215 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba1084a-b421-4736-bcd7-5c7b7587951c None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:36.243493 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba1084a-b421-4736-bcd7-5c7b7587951c None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:36.243761 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba1084a-b421-4736-bcd7-5c7b7587951c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:36.244603 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba1084a-b421-4736-bcd7-5c7b7587951c None admin] RBAC: Adding query filter params (role.id=c0143e35c1344a39a931bbb6bcd5acdc, scope.project.id=63557f0ff1ce4ae49899b4627bafd94e, user.id=b4c33c3fc318484d9cdfae778d23f06a) {{(pid=87276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:27:36.244806 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba1084a-b421-4736-bcd7-5c7b7587951c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:36.246265 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba1084a-b421-4736-bcd7-5c7b7587951c None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:36.256181 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 367/742] 10.222.0.104 () {56 vars in 1379 bytes} [Tue Aug 9 16:27:36 2022] GET /identity/v3/role_assignments?user.id=b4c33c3fc318484d9cdfae778d23f06a&scope.project.id=63557f0ff1ce4ae49899b4627bafd94e&role.id=c0143e35c1344a39a931bbb6bcd5acdc => generated 610 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:27:36.304146 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:36.357990 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69858626-6011-4e6f-95ad-ebb7ca2326bb None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:36.401868 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55291a9-3d14-455c-aa14-355860f4c58b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:36.403033 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55291a9-3d14-455c-aa14-355860f4c58b None admin] REQUEST_METHOD: `POST` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:36.403521 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55291a9-3d14-455c-aa14-355860f4c58b None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:36.404011 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55291a9-3d14-455c-aa14-355860f4c58b None admin] PATH_INFO: `/v3/endpoints` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:36.404890 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55291a9-3d14-455c-aa14-355860f4c58b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:36.406563 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55291a9-3d14-455c-aa14-355860f4c58b None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:36.430548 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 376/743] 10.222.0.104 () {60 vars in 1149 bytes} [Tue Aug 9 16:27:36 2022] POST /identity/v3/endpoints => generated 339 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 16:27:36.861589 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8791dd-51a1-4deb-a772-7917b257d10b None None] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:36.862161 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8791dd-51a1-4deb-a772-7917b257d10b None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:36.862161 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8791dd-51a1-4deb-a772-7917b257d10b None None] PATH_INFO: `/` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:36.863516 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 368/744] 10.222.0.104 () {54 vars in 932 bytes} [Tue Aug 9 16:27:36 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:27:36.869239 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26797055-6758-405c-bf51-7536e8bb1b0e None None] REQUEST_METHOD: `POST` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:36.869525 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26797055-6758-405c-bf51-7536e8bb1b0e None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:36.869802 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26797055-6758-405c-bf51-7536e8bb1b0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:36.888369 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.auth.core [None req-26797055-6758-405c-bf51-7536e8bb1b0e None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:27:36.889558 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.fernet_utils [None req-26797055-6758-405c-bf51-7536e8bb1b0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:27:36.965630 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 377/745] 10.222.0.104 () {58 vars in 1029 bytes} [Tue Aug 9 16:27:36 2022] POST /identity/v3/auth/tokens => generated 1409 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 16:27:36.989088 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8791dd-51a1-4deb-a772-7917b257d10b None None] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:37.089483 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:37.098207 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8791dd-51a1-4deb-a772-7917b257d10b None None] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:37.133315 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31bdcf0-f4fd-425d-b863-ec79cd5573f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:37.134034 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31bdcf0-f4fd-425d-b863-ec79cd5573f3 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:37.134313 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31bdcf0-f4fd-425d-b863-ec79cd5573f3 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:37.134580 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31bdcf0-f4fd-425d-b863-ec79cd5573f3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:37.201581 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31bdcf0-f4fd-425d-b863-ec79cd5573f3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:37.203066 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31bdcf0-f4fd-425d-b863-ec79cd5573f3 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:37.294973 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:37.303655 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 369/746] 10.222.0.104 () {58 vars in 1287 bytes} [Tue Aug 9 16:27:36 2022] GET /identity/v3/auth/tokens => generated 1409 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 09 16:27:37.309888 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26797055-6758-405c-bf51-7536e8bb1b0e None None] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:37.355023 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:37.416796 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26797055-6758-405c-bf51-7536e8bb1b0e None None] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:37.451887 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914d2812-c030-476e-be8b-44c979548539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:37.452511 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914d2812-c030-476e-be8b-44c979548539 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:37.452784 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914d2812-c030-476e-be8b-44c979548539 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:37.453052 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914d2812-c030-476e-be8b-44c979548539 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:37.463840 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914d2812-c030-476e-be8b-44c979548539 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:37.465273 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914d2812-c030-476e-be8b-44c979548539 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:37.480889 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application [None req-914d2812-c030-476e-be8b-44c979548539 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 16:27:37.480889 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:27:37.480889 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:27:37.480889 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:27:37.480889 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:27:37.480889 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:27:37.480889 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:27:37.480889 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:27:37.480889 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:27:37.480889 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:27:37.480889 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:27:37.480889 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:27:37.480889 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 16:27:37.480889 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 16:27:37.480889 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 16:27:37.480889 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 16:27:37.481850 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:27:37.481850 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:27:37.481850 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:27:37.481850 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:27:37.481850 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:27:37.481850 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:27:37.481850 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:27:37.481850 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application with Lock( Aug 09 16:27:37.481850 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:27:37.481850 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:27:37.481850 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:27:37.481850 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:27:37.481850 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:27:37.481850 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:27:37.481850 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:27:37.481850 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:27:37.481850 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 16:27:37.488017 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 16:27:37.488017 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 16:27:37.488017 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Aug 09 16:27:37.488017 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 378/747] 10.222.0.104 () {56 vars in 1113 bytes} [Tue Aug 9 16:27:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 16:27:37.488305 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31bdcf0-f4fd-425d-b863-ec79cd5573f3 None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:37.590155 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31bdcf0-f4fd-425d-b863-ec79cd5573f3 None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:37.624574 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4616be8-41bb-41b8-b583-dfaf6a3e8a06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:37.625097 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4616be8-41bb-41b8-b583-dfaf6a3e8a06 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:37.625378 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4616be8-41bb-41b8-b583-dfaf6a3e8a06 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:37.625648 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4616be8-41bb-41b8-b583-dfaf6a3e8a06 None admin] PATH_INFO: `/v3/domains` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:37.626314 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4616be8-41bb-41b8-b583-dfaf6a3e8a06 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:27:37.626618 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4616be8-41bb-41b8-b583-dfaf6a3e8a06 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:37.627977 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4616be8-41bb-41b8-b583-dfaf6a3e8a06 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:37.639288 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 370/748] 10.222.0.104 () {56 vars in 1114 bytes} [Tue Aug 9 16:27:37 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:27:38.485424 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9079f90b-0d7b-4abe-9721-83d5fc2adb2e None None] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:38.486014 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9079f90b-0d7b-4abe-9721-83d5fc2adb2e None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:38.486014 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9079f90b-0d7b-4abe-9721-83d5fc2adb2e None None] PATH_INFO: `/` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:38.487302 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 379/749] 10.222.0.104 () {54 vars in 932 bytes} [Tue Aug 9 16:27:38 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:27:38.492537 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d35a8f-b98b-45dc-ae1a-f893aefa740c None None] REQUEST_METHOD: `POST` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:38.492924 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d35a8f-b98b-45dc-ae1a-f893aefa740c None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:38.493223 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d35a8f-b98b-45dc-ae1a-f893aefa740c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:38.511334 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.auth.core [None req-a5d35a8f-b98b-45dc-ae1a-f893aefa740c None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:27:38.512527 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.fernet_utils [None req-a5d35a8f-b98b-45dc-ae1a-f893aefa740c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:27:38.560808 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:38.581048 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 371/750] 10.222.0.104 () {58 vars in 1029 bytes} [Tue Aug 9 16:27:38 2022] POST /identity/v3/auth/tokens => generated 1409 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 16:27:38.604607 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9079f90b-0d7b-4abe-9721-83d5fc2adb2e None None] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:38.658674 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a99c71-deef-4cc3-8571-2738b21f230a None None] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:38.658954 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a99c71-deef-4cc3-8571-2738b21f230a None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:38.659224 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a99c71-deef-4cc3-8571-2738b21f230a None None] PATH_INFO: `/` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:38.660550 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 372/751] 10.222.0.104 () {54 vars in 932 bytes} [Tue Aug 9 16:27:38 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 09 16:27:38.665480 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88bfa36-51a9-4479-b1f2-e6a9abbcb93f None None] REQUEST_METHOD: `POST` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:38.665755 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88bfa36-51a9-4479-b1f2-e6a9abbcb93f None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:38.666053 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88bfa36-51a9-4479-b1f2-e6a9abbcb93f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:38.683958 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.auth.core [None req-c88bfa36-51a9-4479-b1f2-e6a9abbcb93f None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:27:38.685153 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.fernet_utils [None req-c88bfa36-51a9-4479-b1f2-e6a9abbcb93f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:27:38.699864 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:38.710303 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9079f90b-0d7b-4abe-9721-83d5fc2adb2e None None] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:38.750567 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15715e62-3d25-4d78-987e-7afbceb8953f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:38.751124 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15715e62-3d25-4d78-987e-7afbceb8953f None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:38.751398 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15715e62-3d25-4d78-987e-7afbceb8953f None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:38.751668 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15715e62-3d25-4d78-987e-7afbceb8953f None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:38.752250 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15715e62-3d25-4d78-987e-7afbceb8953f None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:38.753629 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15715e62-3d25-4d78-987e-7afbceb8953f None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:38.761873 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 373/752] 10.222.0.104 () {58 vars in 1029 bytes} [Tue Aug 9 16:27:38 2022] POST /identity/v3/auth/tokens => generated 1409 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 09 16:27:38.763214 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application [None req-15715e62-3d25-4d78-987e-7afbceb8953f None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 09 16:27:38.763214 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:27:38.763214 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 16:27:38.763214 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 16:27:38.763214 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 16:27:38.763214 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 16:27:38.763214 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 16:27:38.763214 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 16:27:38.763214 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 09 16:27:38.763214 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Aug 09 16:27:38.763214 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 16:27:38.763214 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Aug 09 16:27:38.763214 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:27:38.763214 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:27:38.763214 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:27:38.763214 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:27:38.763214 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:27:38.764404 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:27:38.764404 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:27:38.764404 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:27:38.764404 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:27:38.764404 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:27:38.764404 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:27:38.764404 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 16:27:38.764404 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 16:27:38.764404 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 16:27:38.764404 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 16:27:38.764404 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:27:38.764404 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:27:38.764404 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:27:38.764404 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:27:38.764404 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:27:38.764404 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:27:38.765457 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:27:38.765457 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application with Lock( Aug 09 16:27:38.765457 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:27:38.765457 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:27:38.765457 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:27:38.765457 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:27:38.765457 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:27:38.765457 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:27:38.765457 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:27:38.765457 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:27:38.765457 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 16:27:38.765457 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 16:27:38.765457 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 09 16:27:38.765457 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Aug 09 16:27:38.771829 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 380/753] 10.222.0.104 () {56 vars in 1119 bytes} [Tue Aug 9 16:27:38 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 16:27:38.772851 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88bfa36-51a9-4479-b1f2-e6a9abbcb93f None None] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:38.785534 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15715e62-3d25-4d78-987e-7afbceb8953f None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:38.870870 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88bfa36-51a9-4479-b1f2-e6a9abbcb93f None None] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:38.881572 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15715e62-3d25-4d78-987e-7afbceb8953f None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:38.884925 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:38.904972 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1751b121-8699-4918-be73-b66221e813e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:38.905569 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1751b121-8699-4918-be73-b66221e813e5 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:38.905845 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1751b121-8699-4918-be73-b66221e813e5 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:38.906150 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1751b121-8699-4918-be73-b66221e813e5 None admin] PATH_INFO: `/v3/services` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:38.906763 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1751b121-8699-4918-be73-b66221e813e5 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=87276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:27:38.907063 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1751b121-8699-4918-be73-b66221e813e5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:38.908410 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1751b121-8699-4918-be73-b66221e813e5 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:38.912788 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 374/754] 10.222.0.104 () {56 vars in 1119 bytes} [Tue Aug 9 16:27:38 2022] GET /identity/v3/services?name=volumev3 => generated 126 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:27:38.914321 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12325191-4b47-41a2-8fb0-1fc565e75020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:38.914995 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12325191-4b47-41a2-8fb0-1fc565e75020 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:38.915276 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12325191-4b47-41a2-8fb0-1fc565e75020 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:38.915550 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12325191-4b47-41a2-8fb0-1fc565e75020 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:38.916132 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12325191-4b47-41a2-8fb0-1fc565e75020 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:38.917589 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12325191-4b47-41a2-8fb0-1fc565e75020 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:38.918652 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1751b121-8699-4918-be73-b66221e813e5 None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:38.926478 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application [None req-12325191-4b47-41a2-8fb0-1fc565e75020 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 09 16:27:38.926478 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:27:38.926478 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 16:27:38.926478 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 16:27:38.926478 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 16:27:38.926478 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 16:27:38.926478 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 16:27:38.926478 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 16:27:38.926478 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 09 16:27:38.926478 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Aug 09 16:27:38.926478 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 16:27:38.926478 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Aug 09 16:27:38.926478 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:27:38.926478 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:27:38.926478 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:27:38.926478 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:27:38.927437 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:27:38.927437 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:27:38.927437 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:27:38.927437 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:27:38.927437 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:27:38.927437 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:27:38.927437 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:27:38.927437 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 16:27:38.927437 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 16:27:38.927437 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 16:27:38.927437 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 16:27:38.927437 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:27:38.927437 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:27:38.927437 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:27:38.927437 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:27:38.927437 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:27:38.927437 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:27:38.928326 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:27:38.928326 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application with Lock( Aug 09 16:27:38.928326 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:27:38.928326 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:27:38.928326 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:27:38.928326 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:27:38.928326 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:27:38.928326 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:27:38.928326 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:27:38.928326 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:27:38.928326 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 16:27:38.928326 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 16:27:38.928326 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 09 16:27:38.928326 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Aug 09 16:27:38.928326 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 381/755] 10.222.0.104 () {56 vars in 1137 bytes} [Tue Aug 9 16:27:38 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 142 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 16:27:38.934175 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12325191-4b47-41a2-8fb0-1fc565e75020 None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:38.956462 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:39.027103 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1751b121-8699-4918-be73-b66221e813e5 None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:39.044707 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12325191-4b47-41a2-8fb0-1fc565e75020 None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:39.061779 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc936e89-b77c-4ac0-99a8-3c8f2f832140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:39.062420 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc936e89-b77c-4ac0-99a8-3c8f2f832140 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:39.062697 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc936e89-b77c-4ac0-99a8-3c8f2f832140 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:39.062966 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc936e89-b77c-4ac0-99a8-3c8f2f832140 None admin] PATH_INFO: `/v3/services` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:39.063591 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc936e89-b77c-4ac0-99a8-3c8f2f832140 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=87276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:27:39.063898 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc936e89-b77c-4ac0-99a8-3c8f2f832140 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:39.065277 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc936e89-b77c-4ac0-99a8-3c8f2f832140 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:39.069811 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 375/756] 10.222.0.104 () {56 vars in 1119 bytes} [Tue Aug 9 16:27:38 2022] GET /identity/v3/services?type=volumev3 => generated 126 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:27:39.080499 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665eab3f-52db-4475-9cb5-1f93ad60747e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:39.081126 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665eab3f-52db-4475-9cb5-1f93ad60747e None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:39.081402 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665eab3f-52db-4475-9cb5-1f93ad60747e None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:39.081670 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665eab3f-52db-4475-9cb5-1f93ad60747e None admin] PATH_INFO: `/v3/services` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:39.082372 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665eab3f-52db-4475-9cb5-1f93ad60747e None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=87275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:27:39.082672 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665eab3f-52db-4475-9cb5-1f93ad60747e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:39.084074 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665eab3f-52db-4475-9cb5-1f93ad60747e None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:39.089455 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 382/757] 10.222.0.104 () {56 vars in 1131 bytes} [Tue Aug 9 16:27:38 2022] GET /identity/v3/services?name=compute_legacy => generated 132 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:27:39.095366 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc936e89-b77c-4ac0-99a8-3c8f2f832140 None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:39.142911 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:39.207491 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc936e89-b77c-4ac0-99a8-3c8f2f832140 None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:39.244870 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2848f6f2-c802-4a45-b9f1-b234683f8ed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:39.245475 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2848f6f2-c802-4a45-b9f1-b234683f8ed1 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:39.245749 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2848f6f2-c802-4a45-b9f1-b234683f8ed1 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:39.246049 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2848f6f2-c802-4a45-b9f1-b234683f8ed1 None admin] PATH_INFO: `/v3/services` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:39.246674 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2848f6f2-c802-4a45-b9f1-b234683f8ed1 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=87276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:27:39.247664 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2848f6f2-c802-4a45-b9f1-b234683f8ed1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:39.249032 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2848f6f2-c802-4a45-b9f1-b234683f8ed1 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:39.254516 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 376/758] 10.222.0.104 () {56 vars in 1131 bytes} [Tue Aug 9 16:27:39 2022] GET /identity/v3/services?type=compute_legacy => generated 132 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:27:41.342526 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5b6d0d-b2ee-4f96-a966-b69526a46c29 None None] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:41.343059 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5b6d0d-b2ee-4f96-a966-b69526a46c29 None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:41.343059 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5b6d0d-b2ee-4f96-a966-b69526a46c29 None None] PATH_INFO: `/` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:41.344385 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 383/759] 10.222.0.104 () {54 vars in 932 bytes} [Tue Aug 9 16:27:41 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:27:41.349627 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a517e20-e09b-4325-b695-7958fcb2604a None None] REQUEST_METHOD: `POST` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:41.350073 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a517e20-e09b-4325-b695-7958fcb2604a None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:41.350335 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a517e20-e09b-4325-b695-7958fcb2604a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:41.368425 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.auth.core [None req-2a517e20-e09b-4325-b695-7958fcb2604a None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:27:41.369652 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.fernet_utils [None req-2a517e20-e09b-4325-b695-7958fcb2604a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:27:41.435530 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 377/760] 10.222.0.104 () {58 vars in 1029 bytes} [Tue Aug 9 16:27:41 2022] POST /identity/v3/auth/tokens => generated 1409 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 09 16:27:41.458824 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5b6d0d-b2ee-4f96-a966-b69526a46c29 None None] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:41.512883 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ebb8f9-00b3-4b73-9bb6-a7a48e2855d5 None None] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:41.513169 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ebb8f9-00b3-4b73-9bb6-a7a48e2855d5 None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:41.513441 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ebb8f9-00b3-4b73-9bb6-a7a48e2855d5 None None] PATH_INFO: `/` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:41.515085 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 378/761] 10.222.0.104 () {54 vars in 932 bytes} [Tue Aug 9 16:27:41 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 09 16:27:41.519719 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ebabc3-0a34-4c7c-9a03-b11939a8a03d None None] REQUEST_METHOD: `POST` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:41.520081 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ebabc3-0a34-4c7c-9a03-b11939a8a03d None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:41.520352 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ebabc3-0a34-4c7c-9a03-b11939a8a03d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:41.538271 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.auth.core [None req-e8ebabc3-0a34-4c7c-9a03-b11939a8a03d None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:27:41.539469 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.fernet_utils [None req-e8ebabc3-0a34-4c7c-9a03-b11939a8a03d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:27:41.543450 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:41.560903 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5b6d0d-b2ee-4f96-a966-b69526a46c29 None None] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:41.568040 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:41.603755 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d24299-1cc8-425e-a237-0b2df6846033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:41.604277 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d24299-1cc8-425e-a237-0b2df6846033 None admin] REQUEST_METHOD: `POST` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:41.604555 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d24299-1cc8-425e-a237-0b2df6846033 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:41.604826 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d24299-1cc8-425e-a237-0b2df6846033 None admin] PATH_INFO: `/v3/services` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:41.605501 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d24299-1cc8-425e-a237-0b2df6846033 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:41.606913 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d24299-1cc8-425e-a237-0b2df6846033 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:41.610188 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 379/762] 10.222.0.104 () {58 vars in 1029 bytes} [Tue Aug 9 16:27:41 2022] POST /identity/v3/auth/tokens => generated 1409 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 09 16:27:41.633553 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 384/763] 10.222.0.104 () {60 vars in 1146 bytes} [Tue Aug 9 16:27:41 2022] POST /identity/v3/services => generated 252 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 16:27:41.634992 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ebabc3-0a34-4c7c-9a03-b11939a8a03d None None] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:41.740036 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ebabc3-0a34-4c7c-9a03-b11939a8a03d None None] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:41.786904 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95197264-f320-49f9-82d1-c08b3e1596ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:41.787523 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95197264-f320-49f9-82d1-c08b3e1596ba None admin] REQUEST_METHOD: `POST` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:41.787807 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95197264-f320-49f9-82d1-c08b3e1596ba None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:41.788215 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95197264-f320-49f9-82d1-c08b3e1596ba None admin] PATH_INFO: `/v3/services` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:41.788865 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95197264-f320-49f9-82d1-c08b3e1596ba None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:41.790870 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95197264-f320-49f9-82d1-c08b3e1596ba None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:41.807108 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 380/764] 10.222.0.104 () {60 vars in 1146 bytes} [Tue Aug 9 16:27:41 2022] POST /identity/v3/services => generated 270 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 16:27:43.940386 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027552de-801f-4882-9d07-212097056b23 None None] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:43.940964 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027552de-801f-4882-9d07-212097056b23 None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:43.941061 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027552de-801f-4882-9d07-212097056b23 None None] PATH_INFO: `/` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:43.942381 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 385/765] 10.222.0.104 () {54 vars in 932 bytes} [Tue Aug 9 16:27:43 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:27:43.948186 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ec1523-4855-4654-9fc1-12fea48529ee None None] REQUEST_METHOD: `POST` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:43.948630 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ec1523-4855-4654-9fc1-12fea48529ee None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:43.948727 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ec1523-4855-4654-9fc1-12fea48529ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:43.966881 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.auth.core [None req-48ec1523-4855-4654-9fc1-12fea48529ee None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:27:43.968078 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.fernet_utils [None req-48ec1523-4855-4654-9fc1-12fea48529ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:27:43.984922 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:44.048085 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 381/766] 10.222.0.104 () {58 vars in 1029 bytes} [Tue Aug 9 16:27:43 2022] POST /identity/v3/auth/tokens => generated 1620 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 16:27:44.073156 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027552de-801f-4882-9d07-212097056b23 None None] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:44.113393 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26853da-5d09-4aa3-a13b-277087db70db None None] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:44.113685 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26853da-5d09-4aa3-a13b-277087db70db None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:44.113988 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26853da-5d09-4aa3-a13b-277087db70db None None] PATH_INFO: `/` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:44.115304 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 382/767] 10.222.0.104 () {54 vars in 932 bytes} [Tue Aug 9 16:27:44 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 09 16:27:44.120549 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b912c8c6-0d8f-4163-8167-e97418f8273f None None] REQUEST_METHOD: `POST` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:44.120828 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b912c8c6-0d8f-4163-8167-e97418f8273f None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:44.121097 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b912c8c6-0d8f-4163-8167-e97418f8273f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:44.139380 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.auth.core [None req-b912c8c6-0d8f-4163-8167-e97418f8273f None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:27:44.140588 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.fernet_utils [None req-b912c8c6-0d8f-4163-8167-e97418f8273f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:27:44.176496 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027552de-801f-4882-9d07-212097056b23 None None] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:44.206162 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 383/768] 10.222.0.104 () {58 vars in 1029 bytes} [Tue Aug 9 16:27:44 2022] POST /identity/v3/auth/tokens => generated 1620 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 09 16:27:44.210832 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aa961a-3af0-473b-a9ca-4889f85ae915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:44.211461 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aa961a-3af0-473b-a9ca-4889f85ae915 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:44.211737 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aa961a-3af0-473b-a9ca-4889f85ae915 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:44.212006 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aa961a-3af0-473b-a9ca-4889f85ae915 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:44.212575 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8aa961a-3af0-473b-a9ca-4889f85ae915 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:44.213961 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8aa961a-3af0-473b-a9ca-4889f85ae915 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:44.222384 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application [None req-a8aa961a-3af0-473b-a9ca-4889f85ae915 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 09 16:27:44.222384 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:27:44.222384 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 16:27:44.222384 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 16:27:44.222384 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 16:27:44.222384 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 16:27:44.222384 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 16:27:44.222384 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 16:27:44.222384 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 09 16:27:44.222384 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Aug 09 16:27:44.222384 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 16:27:44.222384 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Aug 09 16:27:44.222384 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:27:44.222384 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:27:44.222384 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:27:44.222384 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:27:44.222384 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:27:44.228361 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:27:44.228361 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:27:44.228361 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:27:44.228361 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:27:44.228361 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:27:44.228361 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:27:44.228361 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 16:27:44.228361 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 16:27:44.228361 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 16:27:44.228361 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 16:27:44.228361 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:27:44.228361 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:27:44.228361 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:27:44.228361 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:27:44.228361 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:27:44.228361 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:27:44.229297 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:27:44.229297 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application with Lock( Aug 09 16:27:44.229297 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:27:44.229297 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:27:44.229297 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:27:44.229297 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:27:44.229297 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:27:44.229297 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:27:44.229297 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:27:44.229297 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:27:44.229297 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 16:27:44.229297 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 16:27:44.229297 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 09 16:27:44.229297 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Aug 09 16:27:44.229297 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 386/769] 10.222.0.104 () {56 vars in 1119 bytes} [Tue Aug 9 16:27:44 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 16:27:44.230441 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b912c8c6-0d8f-4163-8167-e97418f8273f None None] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:44.230529 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aa961a-3af0-473b-a9ca-4889f85ae915 None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:44.242855 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:44.308453 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:44.331183 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b912c8c6-0d8f-4163-8167-e97418f8273f None None] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:44.332094 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aa961a-3af0-473b-a9ca-4889f85ae915 None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:44.364377 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed48101-af71-4e13-8cbd-7c38157cff61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:44.364586 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c761abc-58a0-4d29-8de3-212c4a56641f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:44.365019 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed48101-af71-4e13-8cbd-7c38157cff61 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:44.365154 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c761abc-58a0-4d29-8de3-212c4a56641f None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:44.365317 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed48101-af71-4e13-8cbd-7c38157cff61 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:44.365430 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c761abc-58a0-4d29-8de3-212c4a56641f None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:44.365583 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed48101-af71-4e13-8cbd-7c38157cff61 None admin] PATH_INFO: `/v3/services` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:44.365682 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c761abc-58a0-4d29-8de3-212c4a56641f None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:44.366235 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed48101-af71-4e13-8cbd-7c38157cff61 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=87276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:27:44.366342 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c761abc-58a0-4d29-8de3-212c4a56641f None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:44.366534 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed48101-af71-4e13-8cbd-7c38157cff61 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:44.368175 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c761abc-58a0-4d29-8de3-212c4a56641f None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:44.368384 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed48101-af71-4e13-8cbd-7c38157cff61 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:44.372933 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 384/770] 10.222.0.104 () {56 vars in 1119 bytes} [Tue Aug 9 16:27:44 2022] GET /identity/v3/services?name=volumev3 => generated 126 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 16:27:44.377735 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application [None req-2c761abc-58a0-4d29-8de3-212c4a56641f None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 09 16:27:44.377735 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:27:44.377735 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 16:27:44.377735 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 16:27:44.377735 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 16:27:44.377735 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 16:27:44.377735 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 16:27:44.377735 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 16:27:44.377735 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 09 16:27:44.377735 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Aug 09 16:27:44.377735 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 16:27:44.377735 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Aug 09 16:27:44.377735 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:27:44.377735 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:27:44.377735 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:27:44.377735 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:27:44.378773 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:27:44.378773 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:27:44.378773 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:27:44.378773 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:27:44.378773 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:27:44.378773 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:27:44.378773 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:27:44.378773 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 16:27:44.378773 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 16:27:44.378773 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 16:27:44.378773 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 16:27:44.378773 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:27:44.378773 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:27:44.378773 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:27:44.378773 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:27:44.378773 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:27:44.378773 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:27:44.379691 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:27:44.379691 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application with Lock( Aug 09 16:27:44.379691 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:27:44.379691 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:27:44.379691 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:27:44.379691 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:27:44.379691 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:27:44.379691 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:27:44.379691 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:27:44.379691 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:27:44.379691 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 16:27:44.379691 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 16:27:44.379691 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 09 16:27:44.379691 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Aug 09 16:27:44.380484 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed48101-af71-4e13-8cbd-7c38157cff61 None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:44.380567 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 387/771] 10.222.0.104 () {56 vars in 1137 bytes} [Tue Aug 9 16:27:44 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 16:27:44.385299 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c761abc-58a0-4d29-8de3-212c4a56641f None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:44.457002 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:44.481448 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed48101-af71-4e13-8cbd-7c38157cff61 None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:44.487248 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c761abc-58a0-4d29-8de3-212c4a56641f None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:44.515880 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3baf8ce-d4e8-44da-ab59-f8ae3decf00c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:44.516476 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3baf8ce-d4e8-44da-ab59-f8ae3decf00c None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:44.516752 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3baf8ce-d4e8-44da-ab59-f8ae3decf00c None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:44.517024 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3baf8ce-d4e8-44da-ab59-f8ae3decf00c None admin] PATH_INFO: `/v3/services` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:44.517639 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3baf8ce-d4e8-44da-ab59-f8ae3decf00c None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=87276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:27:44.518017 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3baf8ce-d4e8-44da-ab59-f8ae3decf00c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:44.519306 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3baf8ce-d4e8-44da-ab59-f8ae3decf00c None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:44.520360 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37269ea5-29c3-4ded-a64b-3590a5bed720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:44.520952 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37269ea5-29c3-4ded-a64b-3590a5bed720 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:44.521357 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37269ea5-29c3-4ded-a64b-3590a5bed720 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:44.521628 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37269ea5-29c3-4ded-a64b-3590a5bed720 None admin] PATH_INFO: `/v3/services` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:44.522286 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37269ea5-29c3-4ded-a64b-3590a5bed720 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=87275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:27:44.522589 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37269ea5-29c3-4ded-a64b-3590a5bed720 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:44.524103 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 385/772] 10.222.0.104 () {56 vars in 1119 bytes} [Tue Aug 9 16:27:44 2022] GET /identity/v3/services?type=volumev3 => generated 364 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 16:27:44.524226 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37269ea5-29c3-4ded-a64b-3590a5bed720 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:44.528559 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 388/773] 10.222.0.104 () {56 vars in 1131 bytes} [Tue Aug 9 16:27:44 2022] GET /identity/v3/services?name=compute_legacy => generated 132 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 16:27:44.529752 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3baf8ce-d4e8-44da-ab59-f8ae3decf00c None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:44.534050 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37269ea5-29c3-4ded-a64b-3590a5bed720 None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:44.538044 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:44.628312 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3baf8ce-d4e8-44da-ab59-f8ae3decf00c None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:44.630481 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37269ea5-29c3-4ded-a64b-3590a5bed720 None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:44.660795 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098e8b89-1d73-480c-88e2-bf21dee76ead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:44.661395 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098e8b89-1d73-480c-88e2-bf21dee76ead None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:44.661673 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098e8b89-1d73-480c-88e2-bf21dee76ead None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:44.662017 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098e8b89-1d73-480c-88e2-bf21dee76ead None admin] PATH_INFO: `/v3/endpoints` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:44.662782 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098e8b89-1d73-480c-88e2-bf21dee76ead None admin] RBAC: Adding query filter params (interface=public, service_id=3a53fb01f9d544d78fcc1b479d5ff956, region_id=RegionOne) {{(pid=87276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:27:44.662894 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007b1874-4660-4e45-a5c7-c5c82f6064f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:44.663095 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098e8b89-1d73-480c-88e2-bf21dee76ead None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:44.663377 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007b1874-4660-4e45-a5c7-c5c82f6064f3 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:44.663650 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007b1874-4660-4e45-a5c7-c5c82f6064f3 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:44.664440 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007b1874-4660-4e45-a5c7-c5c82f6064f3 None admin] PATH_INFO: `/v3/services` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:44.664997 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098e8b89-1d73-480c-88e2-bf21dee76ead None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:44.665100 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007b1874-4660-4e45-a5c7-c5c82f6064f3 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=87275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:27:44.665342 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007b1874-4660-4e45-a5c7-c5c82f6064f3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:44.666708 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007b1874-4660-4e45-a5c7-c5c82f6064f3 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:44.668630 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:44.670435 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 386/774] 10.222.0.104 () {56 vars in 1256 bytes} [Tue Aug 9 16:27:44 2022] GET /identity/v3/endpoints?service_id=3a53fb01f9d544d78fcc1b479d5ff956&interface=public®ion_id=RegionOne => generated 195 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:27:44.672448 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 389/775] 10.222.0.104 () {56 vars in 1131 bytes} [Tue Aug 9 16:27:44 2022] GET /identity/v3/services?type=compute_legacy => generated 388 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 16:27:44.675767 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098e8b89-1d73-480c-88e2-bf21dee76ead None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:44.677805 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007b1874-4660-4e45-a5c7-c5c82f6064f3 None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:44.749600 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:44.782713 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007b1874-4660-4e45-a5c7-c5c82f6064f3 None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:44.783037 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098e8b89-1d73-480c-88e2-bf21dee76ead None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:44.817353 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b58d0e-ec02-4793-825b-975eb42840f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:44.817709 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5a50ac-4c4b-4822-a507-726c36ea66ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:44.817983 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b58d0e-ec02-4793-825b-975eb42840f4 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:44.818268 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b58d0e-ec02-4793-825b-975eb42840f4 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:44.818920 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5a50ac-4c4b-4822-a507-726c36ea66ec None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:44.819088 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b58d0e-ec02-4793-825b-975eb42840f4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:44.819225 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5a50ac-4c4b-4822-a507-726c36ea66ec None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:44.819225 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5a50ac-4c4b-4822-a507-726c36ea66ec None admin] PATH_INFO: `/v3/services` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:44.819489 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b58d0e-ec02-4793-825b-975eb42840f4 None admin] RBAC: Adding query filter params (interface=public, service_id=14e5134fb5a44bf891043fa2a5127235, region_id=RegionOne) {{(pid=87275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:27:44.819489 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b58d0e-ec02-4793-825b-975eb42840f4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:44.819908 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5a50ac-4c4b-4822-a507-726c36ea66ec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:44.821406 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5a50ac-4c4b-4822-a507-726c36ea66ec None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:44.821550 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b58d0e-ec02-4793-825b-975eb42840f4 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:44.827238 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 387/776] 10.222.0.104 () {56 vars in 1092 bytes} [Tue Aug 9 16:27:44 2022] GET /identity/v3/services => generated 1505 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 16:27:44.833119 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 390/777] 10.222.0.104 () {56 vars in 1256 bytes} [Tue Aug 9 16:27:44 2022] GET /identity/v3/endpoints?service_id=14e5134fb5a44bf891043fa2a5127235&interface=public®ion_id=RegionOne => generated 195 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 16:27:44.834671 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5a50ac-4c4b-4822-a507-726c36ea66ec None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:44.940476 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5a50ac-4c4b-4822-a507-726c36ea66ec None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:44.975570 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09010980-d5fc-43f0-bb12-3f621e9d692d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:44.976251 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09010980-d5fc-43f0-bb12-3f621e9d692d None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:44.976476 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09010980-d5fc-43f0-bb12-3f621e9d692d None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:44.976742 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09010980-d5fc-43f0-bb12-3f621e9d692d None admin] PATH_INFO: `/v3/services` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:44.977341 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09010980-d5fc-43f0-bb12-3f621e9d692d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:44.978742 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09010980-d5fc-43f0-bb12-3f621e9d692d None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:44.979982 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:44.986566 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 388/778] 10.222.0.104 () {56 vars in 1092 bytes} [Tue Aug 9 16:27:44 2022] GET /identity/v3/services => generated 1505 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 16:27:47.105424 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840b0271-6dab-4177-8903-ea26e634069d None None] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:47.105967 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840b0271-6dab-4177-8903-ea26e634069d None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:47.105967 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840b0271-6dab-4177-8903-ea26e634069d None None] PATH_INFO: `/` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:47.107231 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 391/779] 10.222.0.104 () {54 vars in 932 bytes} [Tue Aug 9 16:27:47 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:27:47.112498 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be301101-f086-4102-9d71-f522052d3259 None None] REQUEST_METHOD: `POST` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:47.112919 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be301101-f086-4102-9d71-f522052d3259 None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:47.113043 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be301101-f086-4102-9d71-f522052d3259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:47.131277 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.auth.core [None req-be301101-f086-4102-9d71-f522052d3259 None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:27:47.132998 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.fernet_utils [None req-be301101-f086-4102-9d71-f522052d3259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:27:47.197686 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 389/780] 10.222.0.104 () {58 vars in 1029 bytes} [Tue Aug 9 16:27:47 2022] POST /identity/v3/auth/tokens => generated 1620 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 09 16:27:47.221776 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840b0271-6dab-4177-8903-ea26e634069d None None] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:47.245611 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a869cc-243e-4620-a7e2-3c7ef18512f7 None None] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:47.245888 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a869cc-243e-4620-a7e2-3c7ef18512f7 None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:47.246188 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a869cc-243e-4620-a7e2-3c7ef18512f7 None None] PATH_INFO: `/` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:47.247498 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 390/781] 10.222.0.104 () {54 vars in 932 bytes} [Tue Aug 9 16:27:47 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 09 16:27:47.252322 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642bc353-673e-4544-845c-25fb97113ca7 None None] REQUEST_METHOD: `POST` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:47.252603 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642bc353-673e-4544-845c-25fb97113ca7 None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:47.252875 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642bc353-673e-4544-845c-25fb97113ca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:47.271390 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.auth.core [None req-642bc353-673e-4544-845c-25fb97113ca7 None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:27:47.272578 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.fernet_utils [None req-642bc353-673e-4544-845c-25fb97113ca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:27:47.285464 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:47.325850 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840b0271-6dab-4177-8903-ea26e634069d None None] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:47.342315 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 391/782] 10.222.0.104 () {58 vars in 1029 bytes} [Tue Aug 9 16:27:47 2022] POST /identity/v3/auth/tokens => generated 1620 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 09 16:27:47.359720 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dafbeb-34e8-4dce-a1fb-bcd3ed031107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:47.360283 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dafbeb-34e8-4dce-a1fb-bcd3ed031107 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:47.360559 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dafbeb-34e8-4dce-a1fb-bcd3ed031107 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:47.360827 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dafbeb-34e8-4dce-a1fb-bcd3ed031107 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:47.361400 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dafbeb-34e8-4dce-a1fb-bcd3ed031107 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:47.362807 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dafbeb-34e8-4dce-a1fb-bcd3ed031107 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:47.365968 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642bc353-673e-4544-845c-25fb97113ca7 None None] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:47.371977 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application [None req-b9dafbeb-34e8-4dce-a1fb-bcd3ed031107 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 09 16:27:47.371977 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:27:47.371977 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 16:27:47.371977 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 16:27:47.371977 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 16:27:47.371977 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 16:27:47.371977 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 16:27:47.371977 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 16:27:47.371977 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 09 16:27:47.371977 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Aug 09 16:27:47.371977 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 16:27:47.371977 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Aug 09 16:27:47.371977 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:27:47.371977 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:27:47.371977 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:27:47.371977 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:27:47.371977 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:27:47.373208 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:27:47.373208 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:27:47.373208 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:27:47.373208 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:27:47.373208 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:27:47.373208 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:27:47.373208 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 16:27:47.373208 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 16:27:47.373208 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 16:27:47.373208 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 16:27:47.373208 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:27:47.373208 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:27:47.373208 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:27:47.373208 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:27:47.373208 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:27:47.373208 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:27:47.374161 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:27:47.374161 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application with Lock( Aug 09 16:27:47.374161 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:27:47.374161 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:27:47.374161 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:27:47.374161 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:27:47.374161 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:27:47.374161 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:27:47.374161 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:27:47.374161 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:27:47.374161 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 16:27:47.374161 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 16:27:47.374161 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 09 16:27:47.374161 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Aug 09 16:27:47.374161 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 392/783] 10.222.0.104 () {56 vars in 1119 bytes} [Tue Aug 9 16:27:47 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 16:27:47.378832 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dafbeb-34e8-4dce-a1fb-bcd3ed031107 None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:47.425423 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:47.466690 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642bc353-673e-4544-845c-25fb97113ca7 None None] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:47.476600 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dafbeb-34e8-4dce-a1fb-bcd3ed031107 None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:47.501003 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065c526f-a8ad-4724-b7c7-5a0b047c0077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:47.501625 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065c526f-a8ad-4724-b7c7-5a0b047c0077 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:47.501912 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065c526f-a8ad-4724-b7c7-5a0b047c0077 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:47.502505 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065c526f-a8ad-4724-b7c7-5a0b047c0077 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:47.502688 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:47.502844 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065c526f-a8ad-4724-b7c7-5a0b047c0077 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:47.504102 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065c526f-a8ad-4724-b7c7-5a0b047c0077 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:47.512030 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97643960-4d95-43d2-a57e-c873d1d23f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:47.512661 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97643960-4d95-43d2-a57e-c873d1d23f17 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:47.512945 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97643960-4d95-43d2-a57e-c873d1d23f17 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:47.513215 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97643960-4d95-43d2-a57e-c873d1d23f17 None admin] PATH_INFO: `/v3/services` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:47.513463 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application [None req-065c526f-a8ad-4724-b7c7-5a0b047c0077 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 09 16:27:47.513463 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:27:47.513463 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 16:27:47.513463 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 16:27:47.513463 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 16:27:47.513463 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 16:27:47.513463 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 16:27:47.513463 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 16:27:47.513463 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 09 16:27:47.513463 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Aug 09 16:27:47.513463 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 16:27:47.513463 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Aug 09 16:27:47.513463 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:27:47.513463 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:27:47.513463 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:27:47.513463 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:27:47.514424 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:27:47.514424 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:27:47.514424 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:27:47.514424 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:27:47.514424 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:27:47.514424 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:27:47.514424 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:27:47.514424 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 16:27:47.514424 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 16:27:47.514424 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 16:27:47.514424 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 16:27:47.514424 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:27:47.514424 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:27:47.514424 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:27:47.514424 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:27:47.514424 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:27:47.514424 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:27:47.515819 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:27:47.515819 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application with Lock( Aug 09 16:27:47.515819 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:27:47.515819 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:27:47.515819 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:27:47.515819 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:27:47.515819 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:27:47.515819 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:27:47.515819 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:27:47.515819 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:27:47.515819 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 16:27:47.515819 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 16:27:47.515819 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 09 16:27:47.515819 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Aug 09 16:27:47.516563 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97643960-4d95-43d2-a57e-c873d1d23f17 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=87275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:27:47.516563 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97643960-4d95-43d2-a57e-c873d1d23f17 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:47.516694 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 392/784] 10.222.0.104 () {56 vars in 1137 bytes} [Tue Aug 9 16:27:47 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 16:27:47.516760 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97643960-4d95-43d2-a57e-c873d1d23f17 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:47.520232 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 393/785] 10.222.0.104 () {56 vars in 1119 bytes} [Tue Aug 9 16:27:47 2022] GET /identity/v3/services?name=volumev3 => generated 126 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 16:27:47.520642 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065c526f-a8ad-4724-b7c7-5a0b047c0077 None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:47.526256 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97643960-4d95-43d2-a57e-c873d1d23f17 None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:47.616892 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065c526f-a8ad-4724-b7c7-5a0b047c0077 None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:47.623994 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97643960-4d95-43d2-a57e-c873d1d23f17 None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:47.639308 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:47.651674 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894c55a6-f05d-4c36-ac97-a2f029a3d73a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:47.652273 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894c55a6-f05d-4c36-ac97-a2f029a3d73a None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:47.652556 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894c55a6-f05d-4c36-ac97-a2f029a3d73a None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:47.652826 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894c55a6-f05d-4c36-ac97-a2f029a3d73a None admin] PATH_INFO: `/v3/services` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:47.653447 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894c55a6-f05d-4c36-ac97-a2f029a3d73a None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=87276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:27:47.653751 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894c55a6-f05d-4c36-ac97-a2f029a3d73a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:47.655158 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894c55a6-f05d-4c36-ac97-a2f029a3d73a None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:47.657824 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0edb0ef-a402-4b33-92ed-f1521946535a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:47.658446 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0edb0ef-a402-4b33-92ed-f1521946535a None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:47.658715 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0edb0ef-a402-4b33-92ed-f1521946535a None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:47.659004 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0edb0ef-a402-4b33-92ed-f1521946535a None admin] PATH_INFO: `/v3/services` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:47.659615 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0edb0ef-a402-4b33-92ed-f1521946535a None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=87275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:27:47.664600 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0edb0ef-a402-4b33-92ed-f1521946535a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:47.664726 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 393/786] 10.222.0.104 () {56 vars in 1131 bytes} [Tue Aug 9 16:27:47 2022] GET /identity/v3/services?name=compute_legacy => generated 132 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 16:27:47.664825 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0edb0ef-a402-4b33-92ed-f1521946535a None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:47.665579 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894c55a6-f05d-4c36-ac97-a2f029a3d73a None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:47.666458 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 394/787] 10.222.0.104 () {56 vars in 1119 bytes} [Tue Aug 9 16:27:47 2022] GET /identity/v3/services?type=volumev3 => generated 364 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 16:27:47.671798 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0edb0ef-a402-4b33-92ed-f1521946535a None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:47.727840 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:47.768607 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894c55a6-f05d-4c36-ac97-a2f029a3d73a None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:47.776353 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0edb0ef-a402-4b33-92ed-f1521946535a None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:47.805201 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9403e97-2ab8-4131-a2b3-b157e390a2d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:47.805800 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9403e97-2ab8-4131-a2b3-b157e390a2d7 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:47.806236 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9403e97-2ab8-4131-a2b3-b157e390a2d7 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:47.806505 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9403e97-2ab8-4131-a2b3-b157e390a2d7 None admin] PATH_INFO: `/v3/services` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:47.807315 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9403e97-2ab8-4131-a2b3-b157e390a2d7 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=87276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:27:47.807778 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9403e97-2ab8-4131-a2b3-b157e390a2d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:47.809410 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9403e97-2ab8-4131-a2b3-b157e390a2d7 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:47.811406 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7370f47-c317-40cf-bbf2-1d0393cb064f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:47.812140 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7370f47-c317-40cf-bbf2-1d0393cb064f None admin] REQUEST_METHOD: `POST` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:47.812546 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7370f47-c317-40cf-bbf2-1d0393cb064f None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:47.812907 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7370f47-c317-40cf-bbf2-1d0393cb064f None admin] PATH_INFO: `/v3/endpoints` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:47.813817 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7370f47-c317-40cf-bbf2-1d0393cb064f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:47.814560 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 394/788] 10.222.0.104 () {56 vars in 1131 bytes} [Tue Aug 9 16:27:47 2022] GET /identity/v3/services?type=compute_legacy => generated 388 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 16:27:47.816133 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7370f47-c317-40cf-bbf2-1d0393cb064f None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:47.820837 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9403e97-2ab8-4131-a2b3-b157e390a2d7 None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:47.837776 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 395/789] 10.222.0.104 () {60 vars in 1149 bytes} [Tue Aug 9 16:27:47 2022] POST /identity/v3/endpoints => generated 348 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 16:27:47.876242 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:47.932879 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9403e97-2ab8-4131-a2b3-b157e390a2d7 None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:47.973638 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0830951-54ea-485e-9cd9-b29cbd6636b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:47.974286 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0830951-54ea-485e-9cd9-b29cbd6636b1 None admin] REQUEST_METHOD: `POST` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:47.974560 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0830951-54ea-485e-9cd9-b29cbd6636b1 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:47.974825 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0830951-54ea-485e-9cd9-b29cbd6636b1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:47.975487 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0830951-54ea-485e-9cd9-b29cbd6636b1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:47.976909 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0830951-54ea-485e-9cd9-b29cbd6636b1 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:47.998376 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 395/790] 10.222.0.104 () {60 vars in 1149 bytes} [Tue Aug 9 16:27:47 2022] POST /identity/v3/endpoints => generated 349 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 16:27:50.147327 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2200e483-7d74-4e20-9d1c-dfee38d630b2 None None] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:50.147868 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2200e483-7d74-4e20-9d1c-dfee38d630b2 None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:50.147868 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2200e483-7d74-4e20-9d1c-dfee38d630b2 None None] PATH_INFO: `/` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:50.149132 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 396/791] 10.222.0.104 () {54 vars in 932 bytes} [Tue Aug 9 16:27:50 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:27:50.154646 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5953a29d-ee8a-40eb-aa40-947365d769bd None None] REQUEST_METHOD: `POST` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:50.155058 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5953a29d-ee8a-40eb-aa40-947365d769bd None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:50.155281 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5953a29d-ee8a-40eb-aa40-947365d769bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:50.172843 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.auth.core [None req-5953a29d-ee8a-40eb-aa40-947365d769bd None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:27:50.174064 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.fernet_utils [None req-5953a29d-ee8a-40eb-aa40-947365d769bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:27:50.245185 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 396/792] 10.222.0.104 () {58 vars in 1029 bytes} [Tue Aug 9 16:27:50 2022] POST /identity/v3/auth/tokens => generated 1620 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 16:27:50.269494 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2200e483-7d74-4e20-9d1c-dfee38d630b2 None None] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:50.287037 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634369c1-a592-4e25-a473-2ac7fe997496 None None] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:50.287320 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634369c1-a592-4e25-a473-2ac7fe997496 None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:50.287590 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634369c1-a592-4e25-a473-2ac7fe997496 None None] PATH_INFO: `/` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:50.289454 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 397/793] 10.222.0.104 () {54 vars in 932 bytes} [Tue Aug 9 16:27:50 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 09 16:27:50.294236 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c33c3a-e7ef-4fdd-9128-ef123356aa34 None None] REQUEST_METHOD: `POST` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:50.294521 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c33c3a-e7ef-4fdd-9128-ef123356aa34 None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:50.294795 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c33c3a-e7ef-4fdd-9128-ef123356aa34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:50.315122 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.auth.core [None req-36c33c3a-e7ef-4fdd-9128-ef123356aa34 None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:27:50.316310 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.fernet_utils [None req-36c33c3a-e7ef-4fdd-9128-ef123356aa34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:27:50.339338 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:50.375696 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2200e483-7d74-4e20-9d1c-dfee38d630b2 None None] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:50.386137 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 398/794] 10.222.0.104 () {58 vars in 1029 bytes} [Tue Aug 9 16:27:50 2022] POST /identity/v3/auth/tokens => generated 1620 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 09 16:27:50.388432 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:50.409883 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c33c3a-e7ef-4fdd-9128-ef123356aa34 None None] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:50.410500 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8a7378-0786-4589-8854-eb30577dfd63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:50.411105 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8a7378-0786-4589-8854-eb30577dfd63 None admin] REQUEST_METHOD: `POST` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:50.411379 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8a7378-0786-4589-8854-eb30577dfd63 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:50.411658 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8a7378-0786-4589-8854-eb30577dfd63 None admin] PATH_INFO: `/v3/projects` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:50.412299 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8a7378-0786-4589-8854-eb30577dfd63 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:50.414310 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8a7378-0786-4589-8854-eb30577dfd63 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:50.416903 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: WARNING keystone.server.flask.common [None req-2b8a7378-0786-4589-8854-eb30577dfd63 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 09 16:27:50.435068 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.sql.core [None req-2b8a7378-0786-4589-8854-eb30577dfd63 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 09 16:27:50.435068 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 09 16:27:50.435068 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [parameters: {'id': 'bc00677f84014fa2b2bfd152f1d9235f', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 09 16:27:50.435068 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=87275) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 09 16:27:50.451900 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application [None req-2b8a7378-0786-4589-8854-eb30577dfd63 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id bc00677f84014fa2b2bfd152f1d9235f.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id bc00677f84014fa2b2bfd152f1d9235f. Aug 09 16:27:50.451900 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:27:50.451900 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 09 16:27:50.451900 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 09 16:27:50.451900 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 09 16:27:50.451900 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 09 16:27:50.451900 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 09 16:27:50.451900 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application result = self._query(query) Aug 09 16:27:50.451900 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 09 16:27:50.451900 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application conn.query(q) Aug 09 16:27:50.451900 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 09 16:27:50.451900 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 09 16:27:50.451900 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 09 16:27:50.452813 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application result.read() Aug 09 16:27:50.452813 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 09 16:27:50.452813 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 09 16:27:50.452813 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 09 16:27:50.452813 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 09 16:27:50.452813 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 09 16:27:50.452813 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 09 16:27:50.452813 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 09 16:27:50.452813 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 09 16:27:50.452813 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 09 16:27:50.452813 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Aug 09 16:27:50.452813 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 09 16:27:50.452813 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Aug 09 16:27:50.452813 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:27:50.452813 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 09 16:27:50.452813 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 09 16:27:50.452813 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 09 16:27:50.452813 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 09 16:27:50.453925 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 09 16:27:50.453925 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application next(self.gen) Aug 09 16:27:50.453925 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 09 16:27:50.453925 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application yield resource Aug 09 16:27:50.453925 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 09 16:27:50.453925 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application next(self.gen) Aug 09 16:27:50.453925 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 09 16:27:50.453925 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application self.session.rollback() Aug 09 16:27:50.453925 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 09 16:27:50.453925 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application self.force_reraise() Aug 09 16:27:50.453925 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 09 16:27:50.453925 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application raise self.value Aug 09 16:27:50.453925 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 09 16:27:50.453925 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 09 16:27:50.453925 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 09 16:27:50.453925 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application session.commit() Aug 09 16:27:50.453925 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 09 16:27:50.454873 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 09 16:27:50.454873 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 09 16:27:50.454873 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application self._prepare_impl() Aug 09 16:27:50.454873 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 09 16:27:50.454873 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application self.session.flush() Aug 09 16:27:50.454873 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 09 16:27:50.454873 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application self._flush(objects) Aug 09 16:27:50.454873 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 09 16:27:50.454873 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 09 16:27:50.454873 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 09 16:27:50.454873 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application compat.raise_( Aug 09 16:27:50.454873 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 09 16:27:50.454873 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application raise exception Aug 09 16:27:50.454873 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 09 16:27:50.454873 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application flush_context.execute() Aug 09 16:27:50.454873 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 09 16:27:50.454873 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application rec.execute(self) Aug 09 16:27:50.455817 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 09 16:27:50.455817 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 09 16:27:50.455817 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 09 16:27:50.455817 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 09 16:27:50.455817 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 09 16:27:50.455817 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 09 16:27:50.455817 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 09 16:27:50.455817 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 09 16:27:50.455817 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 09 16:27:50.455817 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 09 16:27:50.455817 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 09 16:27:50.455817 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 09 16:27:50.455817 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 09 16:27:50.455817 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 09 16:27:50.455817 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 09 16:27:50.456668 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 09 16:27:50.456668 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 09 16:27:50.456668 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application raise exception Aug 09 16:27:50.456668 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 09 16:27:50.456668 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 09 16:27:50.456668 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 09 16:27:50.456668 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 09 16:27:50.456668 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 09 16:27:50.456668 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application result = self._query(query) Aug 09 16:27:50.456668 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 09 16:27:50.456668 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application conn.query(q) Aug 09 16:27:50.456668 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 09 16:27:50.456668 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 09 16:27:50.456668 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 09 16:27:50.456668 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application result.read() Aug 09 16:27:50.456668 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 09 16:27:50.456668 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 09 16:27:50.457559 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 09 16:27:50.457559 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 09 16:27:50.457559 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 09 16:27:50.457559 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 09 16:27:50.457559 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 09 16:27:50.457559 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 09 16:27:50.457559 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 09 16:27:50.457559 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 09 16:27:50.457559 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application [parameters: {'id': 'bc00677f84014fa2b2bfd152f1d9235f', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 09 16:27:50.457559 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 09 16:27:50.457559 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Aug 09 16:27:50.457559 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 16:27:50.457559 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Aug 09 16:27:50.457559 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:27:50.457559 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 09 16:27:50.458517 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 09 16:27:50.458517 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 09 16:27:50.458517 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 09 16:27:50.458517 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 09 16:27:50.458517 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Aug 09 16:27:50.458517 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 16:27:50.458517 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Aug 09 16:27:50.458517 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:27:50.458517 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:27:50.458517 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:27:50.458517 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:27:50.458517 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:27:50.458517 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:27:50.458517 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:27:50.458517 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:27:50.458517 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:27:50.458517 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:27:50.460942 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:27:50.460942 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 09 16:27:50.460942 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 09 16:27:50.460942 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:27:50.460942 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:27:50.460942 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 09 16:27:50.460942 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 09 16:27:50.460942 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id bc00677f84014fa2b2bfd152f1d9235f. Aug 09 16:27:50.460942 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Aug 09 16:27:50.460942 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 397/795] 10.222.0.104 () {60 vars in 1145 bytes} [Tue Aug 9 16:27:50 2022] POST /identity/v3/projects => generated 262 bytes in 184 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 09 16:27:50.460942 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8a7378-0786-4589-8854-eb30577dfd63 None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:50.514998 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c33c3a-e7ef-4fdd-9128-ef123356aa34 None None] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:50.549318 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3f2419-feb1-4a6a-993f-000c0b57b3b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:50.550098 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3f2419-feb1-4a6a-993f-000c0b57b3b3 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:50.550379 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3f2419-feb1-4a6a-993f-000c0b57b3b3 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:50.550648 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3f2419-feb1-4a6a-993f-000c0b57b3b3 None admin] PATH_INFO: `/v3/services/compute` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:50.551291 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3f2419-feb1-4a6a-993f-000c0b57b3b3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:50.552660 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3f2419-feb1-4a6a-993f-000c0b57b3b3 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:50.560274 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8a7378-0786-4589-8854-eb30577dfd63 None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:50.561477 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application [None req-9f3f2419-feb1-4a6a-993f-000c0b57b3b3 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 09 16:27:50.561477 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:27:50.561477 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 16:27:50.561477 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 16:27:50.561477 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 16:27:50.561477 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 16:27:50.561477 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 16:27:50.561477 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 16:27:50.561477 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 09 16:27:50.561477 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Aug 09 16:27:50.561477 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 16:27:50.561477 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Aug 09 16:27:50.561477 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:27:50.561477 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:27:50.561477 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:27:50.561477 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:27:50.561477 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:27:50.562533 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:27:50.562533 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:27:50.562533 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:27:50.562533 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:27:50.562533 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:27:50.562533 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:27:50.562533 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 16:27:50.562533 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 16:27:50.562533 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 16:27:50.562533 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 16:27:50.562533 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:27:50.562533 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:27:50.562533 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:27:50.562533 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:27:50.562533 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:27:50.562533 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:27:50.563367 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:27:50.563367 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application with Lock( Aug 09 16:27:50.563367 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:27:50.563367 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:27:50.563367 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:27:50.563367 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:27:50.563367 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:27:50.563367 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:27:50.563367 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:27:50.563367 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:27:50.563367 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 16:27:50.563367 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 16:27:50.563367 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 09 16:27:50.563367 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Aug 09 16:27:50.566051 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 399/796] 10.222.0.104 () {56 vars in 1116 bytes} [Tue Aug 9 16:27:50 2022] GET /identity/v3/services/compute => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 16:27:50.568568 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3f2419-feb1-4a6a-993f-000c0b57b3b3 None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:50.593999 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:50.603692 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6ffcc8-da1b-4d9d-bf68-e9946dc5c054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:50.604318 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6ffcc8-da1b-4d9d-bf68-e9946dc5c054 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:50.604591 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6ffcc8-da1b-4d9d-bf68-e9946dc5c054 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:50.604860 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6ffcc8-da1b-4d9d-bf68-e9946dc5c054 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:50.611727 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6ffcc8-da1b-4d9d-bf68-e9946dc5c054 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:50.613721 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6ffcc8-da1b-4d9d-bf68-e9946dc5c054 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:50.625497 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application [None req-0c6ffcc8-da1b-4d9d-bf68-e9946dc5c054 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 16:27:50.625497 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:27:50.625497 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:27:50.625497 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:27:50.625497 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:27:50.625497 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:27:50.625497 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:27:50.625497 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:27:50.625497 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:27:50.625497 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:27:50.625497 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:27:50.625497 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:27:50.625497 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 16:27:50.625497 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 16:27:50.625497 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 16:27:50.626504 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 16:27:50.626504 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:27:50.626504 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:27:50.626504 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:27:50.626504 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:27:50.626504 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:27:50.626504 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:27:50.626504 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:27:50.626504 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application with Lock( Aug 09 16:27:50.626504 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:27:50.626504 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:27:50.626504 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:27:50.626504 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:27:50.626504 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:27:50.626504 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:27:50.626504 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:27:50.626504 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:27:50.627410 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 16:27:50.627410 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 16:27:50.627410 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 16:27:50.627410 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 16:27:50.627410 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 16:27:50.627410 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 16:27:50.627410 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 16:27:50.627410 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Aug 09 16:27:50.627410 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 398/797] 10.222.0.104 () {56 vars in 1116 bytes} [Tue Aug 9 16:27:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 16:27:50.632774 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6ffcc8-da1b-4d9d-bf68-e9946dc5c054 None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:50.660815 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:50.672334 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3f2419-feb1-4a6a-993f-000c0b57b3b3 None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:50.705688 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43235f34-1ec6-47b3-a628-cc6efcf50bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:50.706323 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43235f34-1ec6-47b3-a628-cc6efcf50bc8 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:50.706603 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43235f34-1ec6-47b3-a628-cc6efcf50bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:50.706879 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43235f34-1ec6-47b3-a628-cc6efcf50bc8 None admin] PATH_INFO: `/v3/services` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:50.707505 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43235f34-1ec6-47b3-a628-cc6efcf50bc8 None admin] RBAC: Adding query filter params (name=compute) {{(pid=87276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:27:50.707807 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43235f34-1ec6-47b3-a628-cc6efcf50bc8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:50.709260 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43235f34-1ec6-47b3-a628-cc6efcf50bc8 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:50.713951 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 400/798] 10.222.0.104 () {56 vars in 1117 bytes} [Tue Aug 9 16:27:50 2022] GET /identity/v3/services?name=compute => generated 125 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 16:27:50.719624 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43235f34-1ec6-47b3-a628-cc6efcf50bc8 None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:50.731139 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6ffcc8-da1b-4d9d-bf68-e9946dc5c054 None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:50.764317 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5346295-cd88-4d76-8f9f-86e90ac33304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:50.764947 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5346295-cd88-4d76-8f9f-86e90ac33304 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:50.765306 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5346295-cd88-4d76-8f9f-86e90ac33304 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:50.765577 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5346295-cd88-4d76-8f9f-86e90ac33304 None admin] PATH_INFO: `/v3/projects` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:50.766266 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5346295-cd88-4d76-8f9f-86e90ac33304 None admin] RBAC: Adding query filter params (name=service) {{(pid=87275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:27:50.766570 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5346295-cd88-4d76-8f9f-86e90ac33304 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:50.768020 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5346295-cd88-4d76-8f9f-86e90ac33304 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:50.788168 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 399/799] 10.222.0.104 () {56 vars in 1117 bytes} [Tue Aug 9 16:27:50 2022] GET /identity/v3/projects?name=service => generated 413 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 16:27:50.813757 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:50.829968 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43235f34-1ec6-47b3-a628-cc6efcf50bc8 None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:50.868280 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b8c963-7734-48b5-9644-770f175c0238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:50.868894 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b8c963-7734-48b5-9644-770f175c0238 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:50.869258 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b8c963-7734-48b5-9644-770f175c0238 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:50.869526 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b8c963-7734-48b5-9644-770f175c0238 None admin] PATH_INFO: `/v3/services` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:50.870177 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b8c963-7734-48b5-9644-770f175c0238 None admin] RBAC: Adding query filter params (type=compute) {{(pid=87276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:27:50.870477 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b8c963-7734-48b5-9644-770f175c0238 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:50.871875 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b8c963-7734-48b5-9644-770f175c0238 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:50.877047 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 401/800] 10.222.0.104 () {56 vars in 1117 bytes} [Tue Aug 9 16:27:50 2022] GET /identity/v3/services?type=compute => generated 125 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 16:27:53.165839 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1ea514-b3d1-4121-b284-332866479a6e None None] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:53.166406 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1ea514-b3d1-4121-b284-332866479a6e None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:53.166406 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1ea514-b3d1-4121-b284-332866479a6e None None] PATH_INFO: `/` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:53.168067 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 400/801] 10.222.0.104 () {54 vars in 932 bytes} [Tue Aug 9 16:27:53 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:27:53.173311 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c69c64-6e6b-4405-9afe-55de5430b5fa None None] REQUEST_METHOD: `POST` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:53.173727 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c69c64-6e6b-4405-9afe-55de5430b5fa None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:53.173863 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c69c64-6e6b-4405-9afe-55de5430b5fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:53.192198 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.auth.core [None req-c7c69c64-6e6b-4405-9afe-55de5430b5fa None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:27:53.193375 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.fernet_utils [None req-c7c69c64-6e6b-4405-9afe-55de5430b5fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:27:53.249209 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a285521b-a954-4acd-95d3-a3eaceb796ad None None] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:53.249489 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a285521b-a954-4acd-95d3-a3eaceb796ad None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:53.249764 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a285521b-a954-4acd-95d3-a3eaceb796ad None None] PATH_INFO: `/` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:53.251240 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 401/802] 10.222.0.104 () {54 vars in 932 bytes} [Tue Aug 9 16:27:53 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 09 16:27:53.256079 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937d1e7a-c55c-4da0-9648-79e3b699456d None None] REQUEST_METHOD: `POST` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:53.256364 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937d1e7a-c55c-4da0-9648-79e3b699456d None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:53.256640 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937d1e7a-c55c-4da0-9648-79e3b699456d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:53.258932 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 402/803] 10.222.0.104 () {58 vars in 1029 bytes} [Tue Aug 9 16:27:53 2022] POST /identity/v3/auth/tokens => generated 1620 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 16:27:53.275722 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.auth.core [None req-937d1e7a-c55c-4da0-9648-79e3b699456d None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:27:53.278343 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.fernet_utils [None req-937d1e7a-c55c-4da0-9648-79e3b699456d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:27:53.282638 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c69c64-6e6b-4405-9afe-55de5430b5fa None None] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:53.349191 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 402/804] 10.222.0.104 () {58 vars in 1029 bytes} [Tue Aug 9 16:27:53 2022] POST /identity/v3/auth/tokens => generated 1620 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 09 16:27:53.365955 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:53.377012 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937d1e7a-c55c-4da0-9648-79e3b699456d None None] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:53.386874 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c69c64-6e6b-4405-9afe-55de5430b5fa None None] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:53.395518 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:53.421422 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ba45f9-8425-495c-8eaa-23adc5a1a1e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:53.421995 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ba45f9-8425-495c-8eaa-23adc5a1a1e4 None admin] REQUEST_METHOD: `POST` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:53.422277 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ba45f9-8425-495c-8eaa-23adc5a1a1e4 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:53.422547 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ba45f9-8425-495c-8eaa-23adc5a1a1e4 None admin] PATH_INFO: `/v3/services` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:53.423191 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ba45f9-8425-495c-8eaa-23adc5a1a1e4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:53.424555 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ba45f9-8425-495c-8eaa-23adc5a1a1e4 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:53.440346 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 403/805] 10.222.0.104 () {60 vars in 1146 bytes} [Tue Aug 9 16:27:53 2022] POST /identity/v3/services => generated 243 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 16:27:53.478675 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937d1e7a-c55c-4da0-9648-79e3b699456d None None] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:53.521615 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbba0c86-86d1-4653-9c58-998bf9d40b52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:53.522259 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbba0c86-86d1-4653-9c58-998bf9d40b52 None admin] REQUEST_METHOD: `POST` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:53.522532 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbba0c86-86d1-4653-9c58-998bf9d40b52 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:53.522798 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbba0c86-86d1-4653-9c58-998bf9d40b52 None admin] PATH_INFO: `/v3/users` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:53.523423 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbba0c86-86d1-4653-9c58-998bf9d40b52 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:53.524881 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbba0c86-86d1-4653-9c58-998bf9d40b52 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:53.540515 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.sql.core [None req-fbba0c86-86d1-4653-9c58-998bf9d40b52 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 09 16:27:53.540515 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 09 16:27:53.540515 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [parameters: {'user_id': 'ea4e1a79e56847e1bf98bf5710918343', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 09 16:27:53.540515 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=87275) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 09 16:27:53.547685 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application [None req-fbba0c86-86d1-4653-9c58-998bf9d40b52 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 09 16:27:53.547685 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:27:53.547685 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 09 16:27:53.547685 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 09 16:27:53.547685 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 09 16:27:53.547685 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 09 16:27:53.547685 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 09 16:27:53.547685 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application result = self._query(query) Aug 09 16:27:53.547685 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 09 16:27:53.547685 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application conn.query(q) Aug 09 16:27:53.547685 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 09 16:27:53.547685 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 09 16:27:53.547685 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 09 16:27:53.547685 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application result.read() Aug 09 16:27:53.547685 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 09 16:27:53.548791 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 09 16:27:53.548791 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 09 16:27:53.548791 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 09 16:27:53.548791 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 09 16:27:53.548791 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 09 16:27:53.548791 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 09 16:27:53.548791 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 09 16:27:53.548791 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 09 16:27:53.548791 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Aug 09 16:27:53.548791 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 09 16:27:53.548791 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Aug 09 16:27:53.548791 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:27:53.548791 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 09 16:27:53.548791 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 09 16:27:53.548791 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 09 16:27:53.548791 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 09 16:27:53.548791 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 09 16:27:53.548791 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application next(self.gen) Aug 09 16:27:53.550323 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 09 16:27:53.550323 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application yield resource Aug 09 16:27:53.550323 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 09 16:27:53.550323 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application next(self.gen) Aug 09 16:27:53.550323 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 09 16:27:53.550323 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application self.session.rollback() Aug 09 16:27:53.550323 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 09 16:27:53.550323 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application self.force_reraise() Aug 09 16:27:53.550323 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 09 16:27:53.550323 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application raise self.value Aug 09 16:27:53.550323 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 09 16:27:53.550323 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 09 16:27:53.550323 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 09 16:27:53.550323 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application session.commit() Aug 09 16:27:53.550323 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 09 16:27:53.550323 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 09 16:27:53.550323 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 09 16:27:53.551559 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application self._prepare_impl() Aug 09 16:27:53.551559 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 09 16:27:53.551559 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application self.session.flush() Aug 09 16:27:53.551559 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 09 16:27:53.551559 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application self._flush(objects) Aug 09 16:27:53.551559 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 09 16:27:53.551559 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 09 16:27:53.551559 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 09 16:27:53.551559 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application compat.raise_( Aug 09 16:27:53.551559 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 09 16:27:53.551559 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application raise exception Aug 09 16:27:53.551559 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 09 16:27:53.551559 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application flush_context.execute() Aug 09 16:27:53.551559 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 09 16:27:53.551559 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application rec.execute(self) Aug 09 16:27:53.551559 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 09 16:27:53.551559 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 09 16:27:53.552726 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 09 16:27:53.552726 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 09 16:27:53.552726 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 09 16:27:53.552726 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 09 16:27:53.552726 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 09 16:27:53.552726 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 09 16:27:53.552726 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 09 16:27:53.552726 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 09 16:27:53.552726 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 09 16:27:53.552726 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 09 16:27:53.552726 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 09 16:27:53.552726 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 09 16:27:53.552726 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 09 16:27:53.552726 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 09 16:27:53.552726 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 09 16:27:53.552726 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application raise exception Aug 09 16:27:53.555051 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 09 16:27:53.555051 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 09 16:27:53.555051 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 09 16:27:53.555051 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 09 16:27:53.555051 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 09 16:27:53.555051 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application result = self._query(query) Aug 09 16:27:53.555051 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 09 16:27:53.555051 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application conn.query(q) Aug 09 16:27:53.555051 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 09 16:27:53.555051 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 09 16:27:53.555051 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 09 16:27:53.555051 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application result.read() Aug 09 16:27:53.555051 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 09 16:27:53.555051 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 09 16:27:53.555051 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 09 16:27:53.555051 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 09 16:27:53.556082 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 09 16:27:53.556082 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 09 16:27:53.556082 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 09 16:27:53.556082 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 09 16:27:53.556082 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 09 16:27:53.556082 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 09 16:27:53.556082 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application [parameters: {'user_id': 'ea4e1a79e56847e1bf98bf5710918343', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 09 16:27:53.556082 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 09 16:27:53.556082 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Aug 09 16:27:53.556082 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 16:27:53.556082 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Aug 09 16:27:53.556082 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:27:53.556082 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:27:53.556082 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:27:53.556082 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:27:53.557128 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:27:53.557128 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:27:53.557128 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:27:53.557128 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:27:53.557128 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:27:53.557128 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:27:53.557128 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:27:53.557128 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 09 16:27:53.557128 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 09 16:27:53.557128 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:27:53.557128 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:27:53.557128 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 16:27:53.557128 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 16:27:53.557128 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 16:27:53.557128 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 16:27:53.557128 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 09 16:27:53.557128 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 09 16:27:53.558483 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 09 16:27:53.558483 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 09 16:27:53.558483 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 09 16:27:53.558483 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 09 16:27:53.558483 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 09 16:27:53.558483 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Aug 09 16:27:53.558483 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 403/806] 10.222.0.104 () {60 vars in 1136 bytes} [Tue Aug 9 16:27:53 2022] POST /identity/v3/users => generated 160 bytes in 172 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 09 16:27:53.559218 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ba45f9-8425-495c-8eaa-23adc5a1a1e4 None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:53.659799 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ba45f9-8425-495c-8eaa-23adc5a1a1e4 None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:53.694627 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f20f5a-a0fe-480c-ae81-bbc89e1e9718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:53.695177 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f20f5a-a0fe-480c-ae81-bbc89e1e9718 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:53.695451 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f20f5a-a0fe-480c-ae81-bbc89e1e9718 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:53.695720 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f20f5a-a0fe-480c-ae81-bbc89e1e9718 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:53.703001 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f20f5a-a0fe-480c-ae81-bbc89e1e9718 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:53.704405 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f20f5a-a0fe-480c-ae81-bbc89e1e9718 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:53.706846 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:53.716811 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application [None req-d4f20f5a-a0fe-480c-ae81-bbc89e1e9718 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 09 16:27:53.716811 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:27:53.716811 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:27:53.716811 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:27:53.716811 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:27:53.716811 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:27:53.716811 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:27:53.716811 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:27:53.716811 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:27:53.716811 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:27:53.716811 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:27:53.716811 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:27:53.716811 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 16:27:53.716811 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 16:27:53.716811 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 16:27:53.716811 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 16:27:53.718011 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:27:53.718011 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:27:53.718011 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 16:27:53.718011 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 16:27:53.718011 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 16:27:53.718011 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 16:27:53.718011 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:27:53.718011 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:27:53.718011 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:27:53.718011 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:27:53.718011 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:27:53.718011 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application with Lock( Aug 09 16:27:53.718011 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:27:53.718011 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:27:53.718011 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:27:53.718011 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:27:53.718011 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:27:53.718011 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:27:53.719324 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:27:53.719324 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:27:53.719324 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 16:27:53.719324 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 16:27:53.719324 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 16:27:53.719324 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 16:27:53.719324 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 16:27:53.719324 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 16:27:53.719324 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 09 16:27:53.719324 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Aug 09 16:27:53.719324 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 404/807] 10.222.0.104 () {56 vars in 1104 bytes} [Tue Aug 9 16:27:53 2022] GET /identity/v3/users/cinder => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 16:27:53.724106 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbba0c86-86d1-4653-9c58-998bf9d40b52 None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:53.809281 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:53.832619 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbba0c86-86d1-4653-9c58-998bf9d40b52 None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:53.865994 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d009dd-00e8-4d02-84ab-be4d303523ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:53.866599 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d009dd-00e8-4d02-84ab-be4d303523ec None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:53.866878 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d009dd-00e8-4d02-84ab-be4d303523ec None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:53.867146 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d009dd-00e8-4d02-84ab-be4d303523ec None admin] PATH_INFO: `/v3/users` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:53.867860 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d009dd-00e8-4d02-84ab-be4d303523ec None admin] RBAC: Adding query filter params (name=cinder) {{(pid=87275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:27:53.868162 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d009dd-00e8-4d02-84ab-be4d303523ec None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:53.869782 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d009dd-00e8-4d02-84ab-be4d303523ec None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:53.906237 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 404/808] 10.222.0.104 () {56 vars in 1106 bytes} [Tue Aug 9 16:27:53 2022] GET /identity/v3/users?name=cinder => generated 356 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:27:55.738665 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbb91a1-0653-452b-b57b-a4a8d5ef6b55 None None] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:55.739298 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbb91a1-0653-452b-b57b-a4a8d5ef6b55 None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:55.739298 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbb91a1-0653-452b-b57b-a4a8d5ef6b55 None None] PATH_INFO: `/` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:55.740538 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 405/809] 10.222.0.104 () {54 vars in 932 bytes} [Tue Aug 9 16:27:55 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:27:55.745827 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae08bbf-6bae-488f-848e-e2a6a0051608 None None] REQUEST_METHOD: `POST` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:55.746263 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae08bbf-6bae-488f-848e-e2a6a0051608 None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:55.746403 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae08bbf-6bae-488f-848e-e2a6a0051608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:55.765461 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.auth.core [None req-8ae08bbf-6bae-488f-848e-e2a6a0051608 None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:27:55.766657 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.fernet_utils [None req-8ae08bbf-6bae-488f-848e-e2a6a0051608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:27:55.837268 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 405/810] 10.222.0.104 () {58 vars in 1029 bytes} [Tue Aug 9 16:27:55 2022] POST /identity/v3/auth/tokens => generated 1716 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 16:27:55.860460 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbb91a1-0653-452b-b57b-a4a8d5ef6b55 None None] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:55.959825 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbb91a1-0653-452b-b57b-a4a8d5ef6b55 None None] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:55.993038 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feae3130-84ca-4a6b-8deb-5846a52230f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:55.993622 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feae3130-84ca-4a6b-8deb-5846a52230f0 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:55.993934 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feae3130-84ca-4a6b-8deb-5846a52230f0 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:55.994206 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feae3130-84ca-4a6b-8deb-5846a52230f0 None admin] PATH_INFO: `/v3/services/compute` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:55.994783 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feae3130-84ca-4a6b-8deb-5846a52230f0 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:55.996143 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feae3130-84ca-4a6b-8deb-5846a52230f0 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:56.004690 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application [None req-feae3130-84ca-4a6b-8deb-5846a52230f0 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 09 16:27:56.004690 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:27:56.004690 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 16:27:56.004690 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 16:27:56.004690 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 16:27:56.004690 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 16:27:56.004690 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 16:27:56.004690 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 16:27:56.004690 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 09 16:27:56.004690 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Aug 09 16:27:56.004690 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 16:27:56.004690 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Aug 09 16:27:56.004690 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:27:56.004690 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:27:56.004690 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:27:56.004690 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:27:56.004690 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:27:56.005847 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:27:56.005847 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:27:56.005847 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:27:56.005847 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:27:56.005847 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:27:56.005847 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:27:56.005847 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 16:27:56.005847 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 16:27:56.005847 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 16:27:56.005847 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 16:27:56.005847 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:27:56.005847 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:27:56.005847 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:27:56.005847 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:27:56.005847 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:27:56.005847 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:27:56.007259 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:27:56.007259 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application with Lock( Aug 09 16:27:56.007259 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:27:56.007259 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:27:56.007259 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:27:56.007259 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:27:56.007259 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:27:56.007259 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:27:56.007259 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:27:56.007259 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:27:56.007259 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 16:27:56.007259 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 16:27:56.007259 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 09 16:27:56.007259 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Aug 09 16:27:56.007259 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 406/811] 10.222.0.104 () {56 vars in 1116 bytes} [Tue Aug 9 16:27:55 2022] GET /identity/v3/services/compute => generated 88 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 16:27:56.012231 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae08bbf-6bae-488f-848e-e2a6a0051608 None None] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:56.072442 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:56.110995 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae08bbf-6bae-488f-848e-e2a6a0051608 None None] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:56.144489 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66755035-86c1-4205-abc8-152f0498d3a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:56.145090 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66755035-86c1-4205-abc8-152f0498d3a4 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:56.145366 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66755035-86c1-4205-abc8-152f0498d3a4 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:56.145637 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66755035-86c1-4205-abc8-152f0498d3a4 None admin] PATH_INFO: `/v3/services` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:56.146287 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66755035-86c1-4205-abc8-152f0498d3a4 None admin] RBAC: Adding query filter params (name=compute) {{(pid=87275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:27:56.146590 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66755035-86c1-4205-abc8-152f0498d3a4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:56.147978 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66755035-86c1-4205-abc8-152f0498d3a4 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:56.152607 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 406/812] 10.222.0.104 () {56 vars in 1117 bytes} [Tue Aug 9 16:27:56 2022] GET /identity/v3/services?name=compute => generated 125 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:27:56.158409 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feae3130-84ca-4a6b-8deb-5846a52230f0 None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:56.224003 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:56.260552 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feae3130-84ca-4a6b-8deb-5846a52230f0 None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:56.292703 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b1baf0-80d5-419c-891c-b503b92e0896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:56.293295 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b1baf0-80d5-419c-891c-b503b92e0896 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:56.293568 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b1baf0-80d5-419c-891c-b503b92e0896 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:56.293835 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b1baf0-80d5-419c-891c-b503b92e0896 None admin] PATH_INFO: `/v3/services` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:56.294480 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b1baf0-80d5-419c-891c-b503b92e0896 None admin] RBAC: Adding query filter params (type=compute) {{(pid=87276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:27:56.294779 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b1baf0-80d5-419c-891c-b503b92e0896 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:56.296212 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b1baf0-80d5-419c-891c-b503b92e0896 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:56.301854 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 407/813] 10.222.0.104 () {56 vars in 1117 bytes} [Tue Aug 9 16:27:56 2022] GET /identity/v3/services?type=compute => generated 354 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:27:56.308528 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66755035-86c1-4205-abc8-152f0498d3a4 None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:56.405752 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66755035-86c1-4205-abc8-152f0498d3a4 None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:56.432434 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:56.440664 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb2ff0b-60aa-4d15-94fe-4feb64ab422f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:56.441262 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb2ff0b-60aa-4d15-94fe-4feb64ab422f None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:56.441528 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb2ff0b-60aa-4d15-94fe-4feb64ab422f None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:56.441823 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb2ff0b-60aa-4d15-94fe-4feb64ab422f None admin] PATH_INFO: `/v3/endpoints` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:56.442513 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb2ff0b-60aa-4d15-94fe-4feb64ab422f None admin] RBAC: Adding query filter params (interface=public, service_id=62e7b2c42171416dbe4d38aab0eda0f8, region_id=RegionOne) {{(pid=87275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:27:56.442813 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb2ff0b-60aa-4d15-94fe-4feb64ab422f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:56.444304 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb2ff0b-60aa-4d15-94fe-4feb64ab422f None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:56.449189 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 407/814] 10.222.0.104 () {56 vars in 1256 bytes} [Tue Aug 9 16:27:56 2022] GET /identity/v3/endpoints?service_id=62e7b2c42171416dbe4d38aab0eda0f8&interface=public®ion_id=RegionOne => generated 195 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:27:56.454768 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b1baf0-80d5-419c-891c-b503b92e0896 None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:56.550942 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b1baf0-80d5-419c-891c-b503b92e0896 None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:56.576835 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:56.584662 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f9c42c-7be2-4a93-8dfe-2b7a238d198f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:56.585295 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f9c42c-7be2-4a93-8dfe-2b7a238d198f None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:56.585581 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f9c42c-7be2-4a93-8dfe-2b7a238d198f None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:56.585910 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f9c42c-7be2-4a93-8dfe-2b7a238d198f None admin] PATH_INFO: `/v3/services` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:56.586621 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f9c42c-7be2-4a93-8dfe-2b7a238d198f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:56.588124 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f9c42c-7be2-4a93-8dfe-2b7a238d198f None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:56.594309 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 408/815] 10.222.0.104 () {56 vars in 1092 bytes} [Tue Aug 9 16:27:56 2022] GET /identity/v3/services => generated 1736 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 16:27:58.920831 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654e0d1a-529e-4b1c-9a2f-9a7021f0d99b None None] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:58.921346 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654e0d1a-529e-4b1c-9a2f-9a7021f0d99b None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:58.921346 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654e0d1a-529e-4b1c-9a2f-9a7021f0d99b None None] PATH_INFO: `/` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:58.922850 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 408/816] 10.222.0.104 () {54 vars in 932 bytes} [Tue Aug 9 16:27:58 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:27:58.928743 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d91ddd-b323-43dc-afa9-ce2c3dcaef6d None None] REQUEST_METHOD: `POST` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:58.929122 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d91ddd-b323-43dc-afa9-ce2c3dcaef6d None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:58.929307 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d91ddd-b323-43dc-afa9-ce2c3dcaef6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:58.947662 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.auth.core [None req-d9d91ddd-b323-43dc-afa9-ce2c3dcaef6d None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:27:58.948845 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.fernet_utils [None req-d9d91ddd-b323-43dc-afa9-ce2c3dcaef6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:27:59.013001 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 409/817] 10.222.0.104 () {58 vars in 1029 bytes} [Tue Aug 9 16:27:58 2022] POST /identity/v3/auth/tokens => generated 1716 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 16:27:59.037365 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654e0d1a-529e-4b1c-9a2f-9a7021f0d99b None None] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:59.136057 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654e0d1a-529e-4b1c-9a2f-9a7021f0d99b None None] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:59.168970 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9017645-8a4c-4e49-bfef-f202322ea933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:59.169585 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9017645-8a4c-4e49-bfef-f202322ea933 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:59.169861 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9017645-8a4c-4e49-bfef-f202322ea933 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:59.170164 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9017645-8a4c-4e49-bfef-f202322ea933 None admin] PATH_INFO: `/v3/services/compute` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:59.170736 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9017645-8a4c-4e49-bfef-f202322ea933 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:59.172086 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9017645-8a4c-4e49-bfef-f202322ea933 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:59.181194 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application [None req-d9017645-8a4c-4e49-bfef-f202322ea933 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 09 16:27:59.181194 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:27:59.181194 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 16:27:59.181194 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 16:27:59.181194 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 16:27:59.181194 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 16:27:59.181194 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 16:27:59.181194 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 16:27:59.181194 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 09 16:27:59.181194 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Aug 09 16:27:59.181194 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 16:27:59.181194 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Aug 09 16:27:59.181194 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:27:59.181194 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:27:59.181194 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:27:59.181194 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:27:59.181194 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:27:59.182385 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:27:59.182385 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:27:59.182385 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:27:59.182385 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:27:59.182385 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:27:59.182385 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:27:59.182385 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 16:27:59.182385 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 16:27:59.182385 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 16:27:59.182385 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 16:27:59.182385 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:27:59.182385 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:27:59.182385 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:27:59.182385 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:27:59.182385 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:27:59.182385 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:27:59.183412 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:27:59.183412 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application with Lock( Aug 09 16:27:59.183412 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:27:59.183412 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:27:59.183412 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:27:59.183412 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:27:59.183412 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:27:59.183412 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:27:59.183412 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:27:59.183412 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:27:59.183412 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 16:27:59.183412 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 16:27:59.183412 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 09 16:27:59.183412 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Aug 09 16:27:59.183412 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 409/818] 10.222.0.104 () {56 vars in 1116 bytes} [Tue Aug 9 16:27:59 2022] GET /identity/v3/services/compute => generated 88 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 16:27:59.188440 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d91ddd-b323-43dc-afa9-ce2c3dcaef6d None None] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:59.282994 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d91ddd-b323-43dc-afa9-ce2c3dcaef6d None None] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:59.305286 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:59.316956 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbb64b6-9187-43b3-882f-8feecd2f3181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:59.317551 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb64b6-9187-43b3-882f-8feecd2f3181 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:59.317825 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb64b6-9187-43b3-882f-8feecd2f3181 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:59.318125 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb64b6-9187-43b3-882f-8feecd2f3181 None admin] PATH_INFO: `/v3/services` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:59.319383 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbb64b6-9187-43b3-882f-8feecd2f3181 None admin] RBAC: Adding query filter params (name=compute) {{(pid=87276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:27:59.319682 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbb64b6-9187-43b3-882f-8feecd2f3181 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:59.321047 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbb64b6-9187-43b3-882f-8feecd2f3181 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:59.325743 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 410/819] 10.222.0.104 () {56 vars in 1117 bytes} [Tue Aug 9 16:27:59 2022] GET /identity/v3/services?name=compute => generated 125 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:27:59.331721 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9017645-8a4c-4e49-bfef-f202322ea933 None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:59.389614 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:27:59.434324 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9017645-8a4c-4e49-bfef-f202322ea933 None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:59.466570 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf12f06-c768-486a-ac6e-635d21e9915d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:59.467169 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf12f06-c768-486a-ac6e-635d21e9915d None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:59.467449 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf12f06-c768-486a-ac6e-635d21e9915d None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:59.467723 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf12f06-c768-486a-ac6e-635d21e9915d None admin] PATH_INFO: `/v3/services` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:59.468340 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf12f06-c768-486a-ac6e-635d21e9915d None admin] RBAC: Adding query filter params (type=compute) {{(pid=87275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:27:59.468645 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf12f06-c768-486a-ac6e-635d21e9915d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:59.470035 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf12f06-c768-486a-ac6e-635d21e9915d None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:59.475205 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 410/820] 10.222.0.104 () {56 vars in 1117 bytes} [Tue Aug 9 16:27:59 2022] GET /identity/v3/services?type=compute => generated 354 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:27:59.480902 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbb64b6-9187-43b3-882f-8feecd2f3181 None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:27:59.576699 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbb64b6-9187-43b3-882f-8feecd2f3181 None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:27:59.608757 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce556d8b-8cfa-48cf-b473-ea1c2cd36780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:27:59.609341 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce556d8b-8cfa-48cf-b473-ea1c2cd36780 None admin] REQUEST_METHOD: `POST` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:27:59.609614 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce556d8b-8cfa-48cf-b473-ea1c2cd36780 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:27:59.609882 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce556d8b-8cfa-48cf-b473-ea1c2cd36780 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:27:59.610563 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce556d8b-8cfa-48cf-b473-ea1c2cd36780 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:27:59.611905 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce556d8b-8cfa-48cf-b473-ea1c2cd36780 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:27:59.631216 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 411/821] 10.222.0.104 () {60 vars in 1149 bytes} [Tue Aug 9 16:27:59 2022] POST /identity/v3/endpoints => generated 336 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 16:28:09.472343 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=40 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:28:09.626880 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=78,keystone:INSERT=1 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:29:01.279698 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671562e8-06be-4d8a-a2f7-a301bf454284 None None] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:29:01.280855 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671562e8-06be-4d8a-a2f7-a301bf454284 None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:29:01.280944 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671562e8-06be-4d8a-a2f7-a301bf454284 None None] PATH_INFO: `/` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:29:01.282419 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 411/822] 10.222.0.104 () {54 vars in 932 bytes} [Tue Aug 9 16:29:01 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:29:01.289106 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae13db9d-0d13-4c5b-a446-04826789a1a5 None None] REQUEST_METHOD: `POST` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:29:01.289576 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae13db9d-0d13-4c5b-a446-04826789a1a5 None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:29:01.289693 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae13db9d-0d13-4c5b-a446-04826789a1a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:29:01.308929 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.auth.core [None req-ae13db9d-0d13-4c5b-a446-04826789a1a5 None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:29:01.310165 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.fernet_utils [None req-ae13db9d-0d13-4c5b-a446-04826789a1a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:29:01.404936 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 412/823] 10.222.0.104 () {58 vars in 1029 bytes} [Tue Aug 9 16:29:01 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 16:29:01.432854 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671562e8-06be-4d8a-a2f7-a301bf454284 None None] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:29:01.566564 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671562e8-06be-4d8a-a2f7-a301bf454284 None None] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:29:01.606487 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241346c7-fc02-406f-a41e-f4b83b8189d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:29:01.607225 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241346c7-fc02-406f-a41e-f4b83b8189d9 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:29:01.607503 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241346c7-fc02-406f-a41e-f4b83b8189d9 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:29:01.607789 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241346c7-fc02-406f-a41e-f4b83b8189d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:29:01.620402 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241346c7-fc02-406f-a41e-f4b83b8189d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:29:01.621677 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241346c7-fc02-406f-a41e-f4b83b8189d9 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:29:01.642341 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application [None req-241346c7-fc02-406f-a41e-f4b83b8189d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 16:29:01.642341 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:29:01.642341 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:29:01.642341 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:29:01.642341 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:29:01.642341 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:29:01.642341 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:29:01.642341 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:29:01.642341 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:29:01.642341 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:29:01.642341 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:29:01.642341 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:29:01.642341 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 16:29:01.642341 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 16:29:01.642341 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 16:29:01.642341 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 16:29:01.643602 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:29:01.643602 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:29:01.643602 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:29:01.643602 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:29:01.643602 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:29:01.643602 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:29:01.643602 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:29:01.643602 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application with Lock( Aug 09 16:29:01.643602 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:29:01.643602 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:29:01.643602 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:29:01.643602 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:29:01.643602 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:29:01.643602 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:29:01.643602 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:29:01.643602 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:29:01.643602 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 16:29:01.644912 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 16:29:01.644912 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 16:29:01.644912 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Aug 09 16:29:01.644912 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 412/824] 10.222.0.104 () {56 vars in 1113 bytes} [Tue Aug 9 16:29:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 16:29:01.649756 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae13db9d-0d13-4c5b-a446-04826789a1a5 None None] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:29:01.782188 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae13db9d-0d13-4c5b-a446-04826789a1a5 None None] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:29:01.815827 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:29:01.829780 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2a45e4-7e13-4ec3-8208-978ce0d6dc47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:29:01.830921 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2a45e4-7e13-4ec3-8208-978ce0d6dc47 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:29:01.831441 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2a45e4-7e13-4ec3-8208-978ce0d6dc47 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:29:01.831875 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2a45e4-7e13-4ec3-8208-978ce0d6dc47 None admin] PATH_INFO: `/v3/domains` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:29:01.833223 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2a45e4-7e13-4ec3-8208-978ce0d6dc47 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:29:01.833709 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2a45e4-7e13-4ec3-8208-978ce0d6dc47 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:29:01.836146 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2a45e4-7e13-4ec3-8208-978ce0d6dc47 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:29:01.862044 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 413/825] 10.222.0.104 () {56 vars in 1114 bytes} [Tue Aug 9 16:29:01 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:29:01.866580 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241346c7-fc02-406f-a41e-f4b83b8189d9 None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:29:01.944033 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:29:02.013706 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241346c7-fc02-406f-a41e-f4b83b8189d9 None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:29:02.059560 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc65490c-7faf-47a5-9a52-b4b8a8485bd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:29:02.060379 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc65490c-7faf-47a5-9a52-b4b8a8485bd2 None admin] REQUEST_METHOD: `POST` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:29:02.060821 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc65490c-7faf-47a5-9a52-b4b8a8485bd2 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:29:02.061753 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc65490c-7faf-47a5-9a52-b4b8a8485bd2 None admin] PATH_INFO: `/v3/users` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:29:02.062666 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc65490c-7faf-47a5-9a52-b4b8a8485bd2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:29:02.064539 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc65490c-7faf-47a5-9a52-b4b8a8485bd2 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:29:02.099139 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 413/826] 10.222.0.104 () {60 vars in 1137 bytes} [Tue Aug 9 16:29:01 2022] POST /identity/v3/users => generated 252 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 16:29:04.707565 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a069aea-c2e9-4d1d-92d7-07b2670fb362 None None] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:29:04.708203 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a069aea-c2e9-4d1d-92d7-07b2670fb362 None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:29:04.708363 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a069aea-c2e9-4d1d-92d7-07b2670fb362 None None] PATH_INFO: `/` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:29:04.710006 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 414/827] 10.222.0.104 () {54 vars in 932 bytes} [Tue Aug 9 16:29:04 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:29:04.716000 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9f42ae-4e2d-40cd-92d8-9cb752ba3234 None None] REQUEST_METHOD: `POST` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:29:04.716557 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9f42ae-4e2d-40cd-92d8-9cb752ba3234 None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:29:04.716557 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9f42ae-4e2d-40cd-92d8-9cb752ba3234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:29:04.735056 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.auth.core [None req-0e9f42ae-4e2d-40cd-92d8-9cb752ba3234 None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:29:04.736253 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.fernet_utils [None req-0e9f42ae-4e2d-40cd-92d8-9cb752ba3234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:29:04.815943 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 414/828] 10.222.0.104 () {58 vars in 1029 bytes} [Tue Aug 9 16:29:04 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 16:29:04.841284 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a069aea-c2e9-4d1d-92d7-07b2670fb362 None None] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:29:04.964071 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a069aea-c2e9-4d1d-92d7-07b2670fb362 None None] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:29:05.006095 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872eee69-90d4-4f2b-b80a-42980204216d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:29:05.006788 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872eee69-90d4-4f2b-b80a-42980204216d None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:29:05.007066 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872eee69-90d4-4f2b-b80a-42980204216d None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:29:05.007336 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872eee69-90d4-4f2b-b80a-42980204216d None admin] PATH_INFO: `/v3/roles/service` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:29:05.019782 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872eee69-90d4-4f2b-b80a-42980204216d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 16:29:05.024598 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application [None req-872eee69-90d4-4f2b-b80a-42980204216d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 16:29:05.024598 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:29:05.024598 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:29:05.024598 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:29:05.024598 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:29:05.024598 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:29:05.024598 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:29:05.024598 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:29:05.024598 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:29:05.024598 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:29:05.024598 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:29:05.024598 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:29:05.024598 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 16:29:05.024598 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 16:29:05.024598 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 16:29:05.024598 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 16:29:05.025819 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 16:29:05.025819 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 16:29:05.025819 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 16:29:05.025819 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 16:29:05.025819 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:29:05.025819 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:29:05.025819 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:29:05.025819 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:29:05.025819 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:29:05.025819 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:29:05.025819 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:29:05.025819 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application with Lock( Aug 09 16:29:05.025819 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:29:05.025819 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:29:05.025819 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:29:05.025819 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:29:05.027168 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:29:05.027168 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:29:05.027168 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:29:05.027168 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:29:05.027168 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 16:29:05.027168 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 16:29:05.027168 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 16:29:05.027168 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 16:29:05.027168 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 16:29:05.027168 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 16:29:05.027168 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 16:29:05.027168 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Aug 09 16:29:05.027168 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 415/829] 10.222.0.104 () {56 vars in 1107 bytes} [Tue Aug 9 16:29:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 16:29:05.031896 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9f42ae-4e2d-40cd-92d8-9cb752ba3234 None None] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:29:05.078712 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:29:05.151297 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9f42ae-4e2d-40cd-92d8-9cb752ba3234 None None] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:29:05.190249 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d870cf-9882-42a8-bd91-9f019a908e78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:29:05.190856 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d870cf-9882-42a8-bd91-9f019a908e78 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:29:05.191135 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d870cf-9882-42a8-bd91-9f019a908e78 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:29:05.191404 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d870cf-9882-42a8-bd91-9f019a908e78 None admin] PATH_INFO: `/v3/roles` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:29:05.192067 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d870cf-9882-42a8-bd91-9f019a908e78 None admin] RBAC: Adding query filter params (name=service) {{(pid=87275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:29:05.192367 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d870cf-9882-42a8-bd91-9f019a908e78 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:29:05.193728 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d870cf-9882-42a8-bd91-9f019a908e78 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:29:05.205288 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 415/830] 10.222.0.104 () {56 vars in 1108 bytes} [Tue Aug 9 16:29:05 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:29:05.211115 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872eee69-90d4-4f2b-b80a-42980204216d None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:29:05.260124 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:29:05.321470 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872eee69-90d4-4f2b-b80a-42980204216d None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:29:05.358701 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f59b676-49a4-4fda-b245-f4f546b4e9cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:29:05.359334 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f59b676-49a4-4fda-b245-f4f546b4e9cf None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:29:05.359613 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f59b676-49a4-4fda-b245-f4f546b4e9cf None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:29:05.359882 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f59b676-49a4-4fda-b245-f4f546b4e9cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:29:05.372428 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f59b676-49a4-4fda-b245-f4f546b4e9cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:29:05.373868 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f59b676-49a4-4fda-b245-f4f546b4e9cf None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:29:05.387941 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application [None req-1f59b676-49a4-4fda-b245-f4f546b4e9cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 16:29:05.387941 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:29:05.387941 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:29:05.387941 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:29:05.387941 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:29:05.387941 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:29:05.387941 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:29:05.387941 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:29:05.387941 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:29:05.387941 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:29:05.387941 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:29:05.387941 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:29:05.387941 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 16:29:05.387941 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 16:29:05.387941 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 16:29:05.387941 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 16:29:05.389661 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:29:05.389661 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:29:05.389661 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:29:05.389661 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:29:05.389661 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:29:05.389661 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:29:05.389661 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:29:05.389661 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application with Lock( Aug 09 16:29:05.389661 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:29:05.389661 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:29:05.389661 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:29:05.389661 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:29:05.389661 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:29:05.389661 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:29:05.389661 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:29:05.389661 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:29:05.389661 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 16:29:05.391156 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 16:29:05.391156 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 16:29:05.391156 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Aug 09 16:29:05.391156 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 416/831] 10.222.0.104 () {56 vars in 1113 bytes} [Tue Aug 9 16:29:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 16:29:05.395505 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d870cf-9882-42a8-bd91-9f019a908e78 None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:29:05.502381 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:29:05.505563 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d870cf-9882-42a8-bd91-9f019a908e78 None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:29:05.556721 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a879b425-a68b-4b5f-9b13-e132459b06ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:29:05.556721 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a879b425-a68b-4b5f-9b13-e132459b06ac None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:29:05.556721 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a879b425-a68b-4b5f-9b13-e132459b06ac None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:29:05.556721 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a879b425-a68b-4b5f-9b13-e132459b06ac None admin] PATH_INFO: `/v3/domains` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:29:05.557254 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a879b425-a68b-4b5f-9b13-e132459b06ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=87275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:29:05.557254 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a879b425-a68b-4b5f-9b13-e132459b06ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:29:05.557254 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a879b425-a68b-4b5f-9b13-e132459b06ac None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:29:05.563999 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 416/832] 10.222.0.104 () {56 vars in 1114 bytes} [Tue Aug 9 16:29:05 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:29:05.569841 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f59b676-49a4-4fda-b245-f4f546b4e9cf None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:29:05.674742 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:29:05.678868 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f59b676-49a4-4fda-b245-f4f546b4e9cf None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:29:05.718766 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36600df-c461-44f2-9c15-80e6f21bb99d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:29:05.719477 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36600df-c461-44f2-9c15-80e6f21bb99d None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:29:05.719699 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36600df-c461-44f2-9c15-80e6f21bb99d None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:29:05.719912 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36600df-c461-44f2-9c15-80e6f21bb99d None admin] PATH_INFO: `/v3/users/placement` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:29:05.728100 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36600df-c461-44f2-9c15-80e6f21bb99d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:29:05.729922 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36600df-c461-44f2-9c15-80e6f21bb99d None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:29:05.742738 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application [None req-b36600df-c461-44f2-9c15-80e6f21bb99d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 09 16:29:05.742738 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:29:05.742738 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:29:05.742738 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:29:05.742738 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:29:05.742738 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:29:05.742738 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:29:05.742738 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:29:05.742738 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:29:05.742738 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:29:05.742738 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:29:05.742738 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:29:05.742738 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 16:29:05.742738 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 16:29:05.742738 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 16:29:05.742738 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 16:29:05.744038 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:29:05.744038 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:29:05.744038 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 16:29:05.744038 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 16:29:05.744038 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 16:29:05.744038 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 16:29:05.744038 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:29:05.744038 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:29:05.744038 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:29:05.744038 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:29:05.744038 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:29:05.744038 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application with Lock( Aug 09 16:29:05.744038 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:29:05.744038 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:29:05.744038 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:29:05.744038 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:29:05.744038 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:29:05.744038 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:29:05.745196 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:29:05.745196 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:29:05.745196 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 16:29:05.745196 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 16:29:05.745196 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 16:29:05.745196 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 16:29:05.745196 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 16:29:05.745196 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 16:29:05.745196 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 09 16:29:05.745196 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Aug 09 16:29:05.745196 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 417/833] 10.222.0.104 () {56 vars in 1113 bytes} [Tue Aug 9 16:29:05 2022] GET /identity/v3/users/placement => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 16:29:05.751492 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a879b425-a68b-4b5f-9b13-e132459b06ac None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:29:05.871558 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a879b425-a68b-4b5f-9b13-e132459b06ac None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:29:05.906292 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93db093e-4a5d-43dc-926b-8b7cb585dd45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:29:05.906997 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93db093e-4a5d-43dc-926b-8b7cb585dd45 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:29:05.907182 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93db093e-4a5d-43dc-926b-8b7cb585dd45 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:29:05.907444 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93db093e-4a5d-43dc-926b-8b7cb585dd45 None admin] PATH_INFO: `/v3/users` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:29:05.908227 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93db093e-4a5d-43dc-926b-8b7cb585dd45 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:29:05.908608 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93db093e-4a5d-43dc-926b-8b7cb585dd45 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:29:05.910041 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93db093e-4a5d-43dc-926b-8b7cb585dd45 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:29:05.928922 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 417/834] 10.222.0.104 () {56 vars in 1148 bytes} [Tue Aug 9 16:29:05 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 380 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:29:05.935073 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36600df-c461-44f2-9c15-80e6f21bb99d None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:29:06.040778 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36600df-c461-44f2-9c15-80e6f21bb99d None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:29:06.081424 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de21004-fc37-49e7-8742-7f35139523f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:29:06.082068 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de21004-fc37-49e7-8742-7f35139523f1 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:29:06.082344 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de21004-fc37-49e7-8742-7f35139523f1 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:29:06.082655 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de21004-fc37-49e7-8742-7f35139523f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:29:06.114755 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:29:06.160668 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de21004-fc37-49e7-8742-7f35139523f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:29:06.162279 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de21004-fc37-49e7-8742-7f35139523f1 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:29:06.278877 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 418/835] 10.222.0.104 () {58 vars in 1287 bytes} [Tue Aug 9 16:29:05 2022] GET /identity/v3/auth/tokens => generated 1873 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 09 16:29:06.285636 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93db093e-4a5d-43dc-926b-8b7cb585dd45 None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:29:06.307930 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:29:06.407015 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93db093e-4a5d-43dc-926b-8b7cb585dd45 None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:29:06.447638 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2265f42-d698-4ae7-a5fc-3beb5f4d28e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:29:06.448228 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2265f42-d698-4ae7-a5fc-3beb5f4d28e5 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:29:06.448568 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2265f42-d698-4ae7-a5fc-3beb5f4d28e5 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:29:06.448837 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2265f42-d698-4ae7-a5fc-3beb5f4d28e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:29:06.459981 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2265f42-d698-4ae7-a5fc-3beb5f4d28e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:29:06.462024 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2265f42-d698-4ae7-a5fc-3beb5f4d28e5 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:29:06.478841 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application [None req-d2265f42-d698-4ae7-a5fc-3beb5f4d28e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 16:29:06.478841 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:29:06.478841 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:29:06.478841 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:29:06.478841 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:29:06.478841 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:29:06.478841 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:29:06.478841 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:29:06.478841 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:29:06.478841 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:29:06.478841 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:29:06.478841 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:29:06.478841 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 16:29:06.478841 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 16:29:06.478841 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 16:29:06.478841 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 16:29:06.483515 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:29:06.483515 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:29:06.483515 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:29:06.483515 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:29:06.483515 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:29:06.483515 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:29:06.483515 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:29:06.483515 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application with Lock( Aug 09 16:29:06.483515 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:29:06.483515 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:29:06.483515 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:29:06.483515 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:29:06.483515 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:29:06.483515 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:29:06.483515 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:29:06.483515 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:29:06.483515 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 16:29:06.484394 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 16:29:06.484394 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 16:29:06.484394 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Aug 09 16:29:06.484394 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 418/836] 10.222.0.104 () {56 vars in 1113 bytes} [Tue Aug 9 16:29:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 16:29:06.486441 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de21004-fc37-49e7-8742-7f35139523f1 None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:29:06.555865 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:29:06.607232 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de21004-fc37-49e7-8742-7f35139523f1 None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:29:06.646772 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76393e7d-0f09-44ce-98a6-a1cc9bfbe105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:29:06.647391 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76393e7d-0f09-44ce-98a6-a1cc9bfbe105 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:29:06.647665 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76393e7d-0f09-44ce-98a6-a1cc9bfbe105 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:29:06.647930 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76393e7d-0f09-44ce-98a6-a1cc9bfbe105 None admin] PATH_INFO: `/v3/domains` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:29:06.648570 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76393e7d-0f09-44ce-98a6-a1cc9bfbe105 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:29:06.648884 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76393e7d-0f09-44ce-98a6-a1cc9bfbe105 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:29:06.650312 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76393e7d-0f09-44ce-98a6-a1cc9bfbe105 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:29:06.663319 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 419/837] 10.222.0.104 () {56 vars in 1114 bytes} [Tue Aug 9 16:29:06 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 16:29:06.669204 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2265f42-d698-4ae7-a5fc-3beb5f4d28e5 None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:29:06.746893 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:29:06.781112 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2265f42-d698-4ae7-a5fc-3beb5f4d28e5 None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:29:06.836023 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a468eb4b-b4f5-4ec8-8750-34848492c2ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:29:06.836888 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a468eb4b-b4f5-4ec8-8750-34848492c2ab None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:29:06.837331 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a468eb4b-b4f5-4ec8-8750-34848492c2ab None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:29:06.837702 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a468eb4b-b4f5-4ec8-8750-34848492c2ab None admin] PATH_INFO: `/v3/projects/service` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:29:06.845217 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a468eb4b-b4f5-4ec8-8750-34848492c2ab None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:29:06.846676 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a468eb4b-b4f5-4ec8-8750-34848492c2ab None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:29:06.859118 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application [None req-a468eb4b-b4f5-4ec8-8750-34848492c2ab None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 16:29:06.859118 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:29:06.859118 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:29:06.859118 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:29:06.859118 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:29:06.859118 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:29:06.859118 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:29:06.859118 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:29:06.859118 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:29:06.859118 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:29:06.859118 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:29:06.859118 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:29:06.859118 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 16:29:06.859118 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 16:29:06.859118 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 16:29:06.860281 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 16:29:06.860281 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:29:06.860281 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:29:06.860281 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:29:06.860281 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:29:06.860281 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:29:06.860281 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:29:06.860281 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:29:06.860281 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application with Lock( Aug 09 16:29:06.860281 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:29:06.860281 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:29:06.860281 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:29:06.860281 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:29:06.860281 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:29:06.860281 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:29:06.860281 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:29:06.860281 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:29:06.861268 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 16:29:06.861268 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 16:29:06.861268 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 16:29:06.861268 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 16:29:06.861268 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 16:29:06.861268 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 16:29:06.861268 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 16:29:06.861268 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Aug 09 16:29:06.861268 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 419/838] 10.222.0.104 () {56 vars in 1116 bytes} [Tue Aug 9 16:29:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 16:29:06.866517 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76393e7d-0f09-44ce-98a6-a1cc9bfbe105 None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:29:06.977621 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76393e7d-0f09-44ce-98a6-a1cc9bfbe105 None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:29:07.001992 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:29:07.023375 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9d25a3-4bf4-49ba-816e-c25da1208eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:29:07.023980 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9d25a3-4bf4-49ba-816e-c25da1208eef None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:29:07.024256 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9d25a3-4bf4-49ba-816e-c25da1208eef None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:29:07.024525 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9d25a3-4bf4-49ba-816e-c25da1208eef None admin] PATH_INFO: `/v3/projects` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:29:07.025207 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9d25a3-4bf4-49ba-816e-c25da1208eef None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:29:07.025511 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9d25a3-4bf4-49ba-816e-c25da1208eef None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:29:07.027002 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9d25a3-4bf4-49ba-816e-c25da1208eef None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:29:07.039932 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 420/839] 10.222.0.104 () {56 vars in 1153 bytes} [Tue Aug 9 16:29:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:29:07.047315 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a468eb4b-b4f5-4ec8-8750-34848492c2ab None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:29:07.154737 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a468eb4b-b4f5-4ec8-8750-34848492c2ab None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:29:07.184071 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:29:07.191477 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2db6f1b-d1ce-47eb-96c7-9f95aeaafc59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:29:07.192117 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2db6f1b-d1ce-47eb-96c7-9f95aeaafc59 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:29:07.192393 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2db6f1b-d1ce-47eb-96c7-9f95aeaafc59 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:29:07.192660 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2db6f1b-d1ce-47eb-96c7-9f95aeaafc59 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:29:07.193379 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2db6f1b-d1ce-47eb-96c7-9f95aeaafc59 None admin] RBAC: Adding query filter params (role.id=aa624ab843384e48873a8d5a72422836, scope.project.id=63557f0ff1ce4ae49899b4627bafd94e, user.id=cfd1352d64de487ca4675cbe113e919f) {{(pid=87275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:29:07.193684 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2db6f1b-d1ce-47eb-96c7-9f95aeaafc59 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:29:07.195147 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2db6f1b-d1ce-47eb-96c7-9f95aeaafc59 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:29:07.200935 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 420/840] 10.222.0.104 () {56 vars in 1379 bytes} [Tue Aug 9 16:29:07 2022] GET /identity/v3/role_assignments?user.id=cfd1352d64de487ca4675cbe113e919f&scope.project.id=63557f0ff1ce4ae49899b4627bafd94e&role.id=aa624ab843384e48873a8d5a72422836 => generated 260 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:29:09.539417 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa2865e-2ccb-46e0-8b92-1e7aefb5ed06 None None] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:29:09.539973 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa2865e-2ccb-46e0-8b92-1e7aefb5ed06 None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:29:09.539973 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa2865e-2ccb-46e0-8b92-1e7aefb5ed06 None None] PATH_INFO: `/` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:29:09.541289 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 421/841] 10.222.0.104 () {54 vars in 932 bytes} [Tue Aug 9 16:29:09 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:29:09.546849 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bf4bc0-8309-4114-8528-dce911dae5b8 None None] REQUEST_METHOD: `POST` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:29:09.547295 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bf4bc0-8309-4114-8528-dce911dae5b8 None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:29:09.547394 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bf4bc0-8309-4114-8528-dce911dae5b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:29:09.565471 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.auth.core [None req-e1bf4bc0-8309-4114-8528-dce911dae5b8 None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:29:09.566720 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.fernet_utils [None req-e1bf4bc0-8309-4114-8528-dce911dae5b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:29:09.640026 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 421/842] 10.222.0.104 () {58 vars in 1029 bytes} [Tue Aug 9 16:29:09 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 16:29:09.665651 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa2865e-2ccb-46e0-8b92-1e7aefb5ed06 None None] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:29:09.787452 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa2865e-2ccb-46e0-8b92-1e7aefb5ed06 None None] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:29:09.830981 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf20537-8275-4a1f-8d9c-a6d3c5812721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:29:09.832543 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf20537-8275-4a1f-8d9c-a6d3c5812721 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:29:09.833024 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf20537-8275-4a1f-8d9c-a6d3c5812721 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:29:09.833533 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf20537-8275-4a1f-8d9c-a6d3c5812721 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:29:09.848569 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf20537-8275-4a1f-8d9c-a6d3c5812721 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 16:29:09.855204 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application [None req-2cf20537-8275-4a1f-8d9c-a6d3c5812721 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 16:29:09.855204 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:29:09.855204 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:29:09.855204 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:29:09.855204 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:29:09.855204 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:29:09.855204 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:29:09.855204 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:29:09.855204 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:29:09.855204 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:29:09.855204 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:29:09.855204 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:29:09.855204 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 16:29:09.855204 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 16:29:09.855204 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 16:29:09.855204 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 16:29:09.856367 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 16:29:09.856367 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 16:29:09.856367 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 16:29:09.856367 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 16:29:09.856367 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:29:09.856367 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:29:09.856367 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:29:09.856367 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:29:09.856367 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:29:09.856367 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:29:09.856367 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:29:09.856367 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application with Lock( Aug 09 16:29:09.856367 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:29:09.856367 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:29:09.856367 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:29:09.856367 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:29:09.857442 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:29:09.857442 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:29:09.857442 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:29:09.857442 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:29:09.857442 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 16:29:09.857442 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 16:29:09.857442 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 16:29:09.857442 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 16:29:09.857442 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 16:29:09.857442 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 16:29:09.857442 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 16:29:09.857442 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Aug 09 16:29:09.857442 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 422/843] 10.222.0.104 () {56 vars in 1107 bytes} [Tue Aug 9 16:29:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 16:29:09.863341 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bf4bc0-8309-4114-8528-dce911dae5b8 None None] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:29:09.988440 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bf4bc0-8309-4114-8528-dce911dae5b8 None None] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:29:10.017059 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:29:10.029224 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb28487-7b61-4b7c-b778-888ba1c12fe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:29:10.029833 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb28487-7b61-4b7c-b778-888ba1c12fe9 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:29:10.030136 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb28487-7b61-4b7c-b778-888ba1c12fe9 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:29:10.030410 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb28487-7b61-4b7c-b778-888ba1c12fe9 None admin] PATH_INFO: `/v3/roles` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:29:10.031056 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb28487-7b61-4b7c-b778-888ba1c12fe9 None admin] RBAC: Adding query filter params (name=service) {{(pid=87275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:29:10.031353 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb28487-7b61-4b7c-b778-888ba1c12fe9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:29:10.032733 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb28487-7b61-4b7c-b778-888ba1c12fe9 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:29:10.040624 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 422/844] 10.222.0.104 () {56 vars in 1108 bytes} [Tue Aug 9 16:29:09 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:29:10.046694 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf20537-8275-4a1f-8d9c-a6d3c5812721 None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:29:10.092157 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:29:10.156976 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf20537-8275-4a1f-8d9c-a6d3c5812721 None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:29:10.192592 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27104979-3139-42af-8128-ebddbd256fe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:29:10.193249 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27104979-3139-42af-8128-ebddbd256fe2 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:29:10.193650 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27104979-3139-42af-8128-ebddbd256fe2 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:29:10.193838 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27104979-3139-42af-8128-ebddbd256fe2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:29:10.204985 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27104979-3139-42af-8128-ebddbd256fe2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:29:10.206490 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27104979-3139-42af-8128-ebddbd256fe2 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:29:10.222643 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application [None req-27104979-3139-42af-8128-ebddbd256fe2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 16:29:10.222643 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:29:10.222643 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:29:10.222643 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:29:10.222643 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:29:10.222643 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:29:10.222643 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:29:10.222643 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:29:10.222643 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:29:10.222643 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:29:10.222643 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:29:10.222643 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:29:10.222643 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 16:29:10.222643 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 16:29:10.222643 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 16:29:10.222643 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 16:29:10.223787 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:29:10.223787 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:29:10.223787 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:29:10.223787 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:29:10.223787 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:29:10.223787 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:29:10.223787 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:29:10.223787 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application with Lock( Aug 09 16:29:10.223787 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:29:10.223787 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:29:10.223787 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:29:10.223787 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:29:10.223787 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:29:10.223787 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:29:10.223787 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:29:10.223787 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:29:10.223787 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 16:29:10.225072 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 16:29:10.225072 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 16:29:10.225072 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Aug 09 16:29:10.225072 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 423/845] 10.222.0.104 () {56 vars in 1113 bytes} [Tue Aug 9 16:29:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 16:29:10.229566 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb28487-7b61-4b7c-b778-888ba1c12fe9 None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:29:10.335999 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb28487-7b61-4b7c-b778-888ba1c12fe9 None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:29:10.370913 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cde9ff-4679-443a-880d-124c3a978a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:29:10.371431 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cde9ff-4679-443a-880d-124c3a978a18 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:29:10.371712 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cde9ff-4679-443a-880d-124c3a978a18 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:29:10.371999 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cde9ff-4679-443a-880d-124c3a978a18 None admin] PATH_INFO: `/v3/domains` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:29:10.372623 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cde9ff-4679-443a-880d-124c3a978a18 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:29:10.372928 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cde9ff-4679-443a-880d-124c3a978a18 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:29:10.374345 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cde9ff-4679-443a-880d-124c3a978a18 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:29:10.386579 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 423/846] 10.222.0.104 () {56 vars in 1114 bytes} [Tue Aug 9 16:29:10 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 16:29:10.393578 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27104979-3139-42af-8128-ebddbd256fe2 None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:29:10.495354 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:29:10.507147 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27104979-3139-42af-8128-ebddbd256fe2 None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:29:10.548052 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fc743d-7282-4ccc-b48c-15942225833d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:29:10.548728 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fc743d-7282-4ccc-b48c-15942225833d None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:29:10.548963 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fc743d-7282-4ccc-b48c-15942225833d None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:29:10.549374 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fc743d-7282-4ccc-b48c-15942225833d None admin] PATH_INFO: `/v3/users/placement` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:29:10.559910 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fc743d-7282-4ccc-b48c-15942225833d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:29:10.561890 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fc743d-7282-4ccc-b48c-15942225833d None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:29:10.578181 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application [None req-82fc743d-7282-4ccc-b48c-15942225833d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 09 16:29:10.578181 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:29:10.578181 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:29:10.578181 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:29:10.578181 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:29:10.578181 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:29:10.578181 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:29:10.578181 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:29:10.578181 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:29:10.578181 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:29:10.578181 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:29:10.578181 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:29:10.578181 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 16:29:10.578181 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 16:29:10.578181 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 16:29:10.578181 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 16:29:10.579178 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:29:10.579178 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:29:10.579178 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 16:29:10.579178 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 16:29:10.579178 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 16:29:10.579178 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 16:29:10.579178 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:29:10.579178 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:29:10.579178 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:29:10.579178 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:29:10.579178 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:29:10.579178 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application with Lock( Aug 09 16:29:10.579178 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:29:10.579178 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:29:10.579178 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:29:10.579178 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:29:10.579178 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:29:10.579178 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:29:10.580233 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:29:10.580233 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:29:10.580233 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 16:29:10.580233 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 16:29:10.580233 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 16:29:10.580233 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 16:29:10.580233 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 16:29:10.580233 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 16:29:10.580233 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 09 16:29:10.580233 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Aug 09 16:29:10.580233 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 424/847] 10.222.0.104 () {56 vars in 1113 bytes} [Tue Aug 9 16:29:10 2022] GET /identity/v3/users/placement => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 16:29:10.588050 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cde9ff-4679-443a-880d-124c3a978a18 None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:29:10.649544 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:29:10.704716 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cde9ff-4679-443a-880d-124c3a978a18 None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:29:10.740037 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1fccc5-40da-428d-87b8-92b9c6b1276a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:29:10.740764 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1fccc5-40da-428d-87b8-92b9c6b1276a None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:29:10.741156 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1fccc5-40da-428d-87b8-92b9c6b1276a None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:29:10.741336 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1fccc5-40da-428d-87b8-92b9c6b1276a None admin] PATH_INFO: `/v3/users` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:29:10.742077 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1fccc5-40da-428d-87b8-92b9c6b1276a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:29:10.742379 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1fccc5-40da-428d-87b8-92b9c6b1276a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:29:10.743833 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1fccc5-40da-428d-87b8-92b9c6b1276a None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:29:10.764761 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 424/848] 10.222.0.104 () {56 vars in 1148 bytes} [Tue Aug 9 16:29:10 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 380 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:29:10.770705 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fc743d-7282-4ccc-b48c-15942225833d None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:29:10.889503 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fc743d-7282-4ccc-b48c-15942225833d None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:29:10.924910 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f25d15-fad8-4649-a1bf-73c0d5550532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:29:10.925978 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f25d15-fad8-4649-a1bf-73c0d5550532 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:29:10.926290 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f25d15-fad8-4649-a1bf-73c0d5550532 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:29:10.926560 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f25d15-fad8-4649-a1bf-73c0d5550532 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:29:10.938429 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f25d15-fad8-4649-a1bf-73c0d5550532 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:29:10.939858 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f25d15-fad8-4649-a1bf-73c0d5550532 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:29:10.955400 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application [None req-e6f25d15-fad8-4649-a1bf-73c0d5550532 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 16:29:10.955400 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:29:10.955400 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:29:10.955400 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:29:10.955400 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:29:10.955400 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:29:10.955400 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:29:10.955400 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:29:10.955400 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:29:10.955400 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:29:10.955400 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:29:10.955400 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:29:10.955400 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 16:29:10.955400 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 16:29:10.955400 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 16:29:10.955400 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 16:29:10.956387 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:29:10.956387 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:29:10.956387 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:29:10.956387 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:29:10.956387 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:29:10.956387 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:29:10.956387 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:29:10.956387 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application with Lock( Aug 09 16:29:10.956387 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:29:10.956387 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:29:10.956387 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:29:10.956387 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:29:10.956387 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:29:10.956387 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:29:10.956387 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:29:10.956387 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:29:10.956387 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 16:29:10.957258 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 16:29:10.957258 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 16:29:10.957258 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Aug 09 16:29:10.957258 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 425/849] 10.222.0.104 () {56 vars in 1113 bytes} [Tue Aug 9 16:29:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 16:29:10.962417 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1fccc5-40da-428d-87b8-92b9c6b1276a None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:29:11.066543 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1fccc5-40da-428d-87b8-92b9c6b1276a None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:29:11.069074 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:29:11.105953 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaa928d-00b8-47ee-91f7-cf1e35725758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:29:11.106712 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaa928d-00b8-47ee-91f7-cf1e35725758 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:29:11.106988 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaa928d-00b8-47ee-91f7-cf1e35725758 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:29:11.107258 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaa928d-00b8-47ee-91f7-cf1e35725758 None admin] PATH_INFO: `/v3/domains` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:29:11.108061 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaa928d-00b8-47ee-91f7-cf1e35725758 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:29:11.108342 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaa928d-00b8-47ee-91f7-cf1e35725758 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:29:11.110020 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaa928d-00b8-47ee-91f7-cf1e35725758 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:29:11.121703 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 425/850] 10.222.0.104 () {56 vars in 1114 bytes} [Tue Aug 9 16:29:10 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:29:11.128727 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f25d15-fad8-4649-a1bf-73c0d5550532 None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:29:11.131820 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:29:11.250339 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f25d15-fad8-4649-a1bf-73c0d5550532 None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:29:11.288444 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9896d6-09b1-4171-9b1a-107767a9771c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:29:11.289118 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9896d6-09b1-4171-9b1a-107767a9771c None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:29:11.289390 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9896d6-09b1-4171-9b1a-107767a9771c None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:29:11.289669 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9896d6-09b1-4171-9b1a-107767a9771c None admin] PATH_INFO: `/v3/projects/service` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:29:11.297847 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9896d6-09b1-4171-9b1a-107767a9771c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:29:11.299343 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9896d6-09b1-4171-9b1a-107767a9771c None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:29:11.317107 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application [None req-4d9896d6-09b1-4171-9b1a-107767a9771c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 16:29:11.317107 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:29:11.317107 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:29:11.317107 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:29:11.317107 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:29:11.317107 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:29:11.317107 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:29:11.317107 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:29:11.317107 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:29:11.317107 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:29:11.317107 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:29:11.317107 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:29:11.317107 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 16:29:11.317107 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 16:29:11.317107 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 16:29:11.318183 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 16:29:11.318183 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:29:11.318183 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:29:11.318183 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:29:11.318183 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:29:11.318183 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:29:11.318183 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:29:11.318183 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:29:11.318183 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application with Lock( Aug 09 16:29:11.318183 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:29:11.318183 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:29:11.318183 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:29:11.318183 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:29:11.318183 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:29:11.318183 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:29:11.318183 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:29:11.318183 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:29:11.319269 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 16:29:11.319269 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 16:29:11.319269 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 16:29:11.319269 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 16:29:11.319269 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 16:29:11.319269 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 16:29:11.319269 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 16:29:11.319269 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Aug 09 16:29:11.319269 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 426/851] 10.222.0.104 () {56 vars in 1116 bytes} [Tue Aug 9 16:29:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 16:29:11.328543 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaa928d-00b8-47ee-91f7-cf1e35725758 None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:29:11.447107 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaa928d-00b8-47ee-91f7-cf1e35725758 None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:29:11.497887 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bfe840-f1ac-4224-a8d2-3ed646f60af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:29:11.498520 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bfe840-f1ac-4224-a8d2-3ed646f60af1 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:29:11.498795 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bfe840-f1ac-4224-a8d2-3ed646f60af1 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:29:11.499061 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bfe840-f1ac-4224-a8d2-3ed646f60af1 None admin] PATH_INFO: `/v3/projects` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:29:11.499738 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bfe840-f1ac-4224-a8d2-3ed646f60af1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:29:11.500040 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bfe840-f1ac-4224-a8d2-3ed646f60af1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:29:11.501502 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bfe840-f1ac-4224-a8d2-3ed646f60af1 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:29:11.515261 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 426/852] 10.222.0.104 () {56 vars in 1153 bytes} [Tue Aug 9 16:29:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:29:11.522832 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9896d6-09b1-4171-9b1a-107767a9771c None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:29:11.589005 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:29:11.639501 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9896d6-09b1-4171-9b1a-107767a9771c None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:29:11.691118 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c601559-475d-40de-81eb-d545bbdd2331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:29:11.692087 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c601559-475d-40de-81eb-d545bbdd2331 None admin] REQUEST_METHOD: `PUT` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:29:11.692989 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c601559-475d-40de-81eb-d545bbdd2331 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:29:11.693540 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c601559-475d-40de-81eb-d545bbdd2331 None admin] PATH_INFO: `/v3/projects/63557f0ff1ce4ae49899b4627bafd94e/users/cfd1352d64de487ca4675cbe113e919f/roles/aa624ab843384e48873a8d5a72422836` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:29:11.714489 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c601559-475d-40de-81eb-d545bbdd2331 None admin] RBAC: Authorizing `identity:create_grant(project_id=63557f0ff1ce4ae49899b4627bafd94e, user_id=cfd1352d64de487ca4675cbe113e919f, role_id=aa624ab843384e48873a8d5a72422836)` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:29:11.716422 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c601559-475d-40de-81eb-d545bbdd2331 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:29:11.731166 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 427/853] 10.222.0.104 () {58 vars in 1444 bytes} [Tue Aug 9 16:29:11 2022] PUT /identity/v3/projects/63557f0ff1ce4ae49899b4627bafd94e/users/cfd1352d64de487ca4675cbe113e919f/roles/aa624ab843384e48873a8d5a72422836 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 16:29:14.240633 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c1e804-2ab8-48da-8903-eab794cda0ca None None] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:29:14.241229 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c1e804-2ab8-48da-8903-eab794cda0ca None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:29:14.241229 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c1e804-2ab8-48da-8903-eab794cda0ca None None] PATH_INFO: `/` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:29:14.242537 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 427/854] 10.222.0.104 () {54 vars in 932 bytes} [Tue Aug 9 16:29:14 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:29:14.248926 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c1156a-5f7f-449a-a8ee-763d1ea0fd2f None None] REQUEST_METHOD: `POST` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:29:14.249423 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c1156a-5f7f-449a-a8ee-763d1ea0fd2f None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:29:14.249570 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c1156a-5f7f-449a-a8ee-763d1ea0fd2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:29:14.268979 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.auth.core [None req-f5c1156a-5f7f-449a-a8ee-763d1ea0fd2f None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:29:14.270318 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.fernet_utils [None req-f5c1156a-5f7f-449a-a8ee-763d1ea0fd2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:29:14.349393 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 428/855] 10.222.0.104 () {58 vars in 1029 bytes} [Tue Aug 9 16:29:14 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 16:29:14.374999 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c1e804-2ab8-48da-8903-eab794cda0ca None None] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:29:14.402612 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:29:14.486871 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c1e804-2ab8-48da-8903-eab794cda0ca None None] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:29:14.525520 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68128de-bdc7-4331-9366-b74c5adf65fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:29:14.526182 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68128de-bdc7-4331-9366-b74c5adf65fd None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:29:14.526492 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68128de-bdc7-4331-9366-b74c5adf65fd None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:29:14.526797 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68128de-bdc7-4331-9366-b74c5adf65fd None admin] PATH_INFO: `/v3/roles/service` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:29:14.538775 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68128de-bdc7-4331-9366-b74c5adf65fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 16:29:14.544646 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application [None req-f68128de-bdc7-4331-9366-b74c5adf65fd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 16:29:14.544646 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:29:14.544646 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:29:14.544646 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:29:14.544646 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:29:14.544646 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:29:14.544646 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:29:14.544646 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:29:14.544646 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:29:14.544646 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:29:14.544646 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:29:14.544646 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:29:14.544646 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 16:29:14.544646 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 16:29:14.544646 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 16:29:14.544646 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 16:29:14.545786 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 16:29:14.545786 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 16:29:14.545786 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 16:29:14.545786 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 16:29:14.545786 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:29:14.545786 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:29:14.545786 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:29:14.545786 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:29:14.545786 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:29:14.545786 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:29:14.545786 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:29:14.545786 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application with Lock( Aug 09 16:29:14.545786 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:29:14.545786 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:29:14.545786 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:29:14.545786 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:29:14.547094 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:29:14.547094 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:29:14.547094 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:29:14.547094 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:29:14.547094 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 16:29:14.547094 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 16:29:14.547094 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 16:29:14.547094 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 16:29:14.547094 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 16:29:14.547094 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 16:29:14.547094 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 16:29:14.547094 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Aug 09 16:29:14.548851 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 428/856] 10.222.0.104 () {56 vars in 1107 bytes} [Tue Aug 9 16:29:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 16:29:14.556273 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c1156a-5f7f-449a-a8ee-763d1ea0fd2f None None] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:29:14.601696 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:29:14.670719 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c1156a-5f7f-449a-a8ee-763d1ea0fd2f None None] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:29:14.711592 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b37c2d-0227-4067-993e-38587c773df5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:29:14.712257 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b37c2d-0227-4067-993e-38587c773df5 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:29:14.712530 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b37c2d-0227-4067-993e-38587c773df5 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:29:14.712797 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b37c2d-0227-4067-993e-38587c773df5 None admin] PATH_INFO: `/v3/roles` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:29:14.713455 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b37c2d-0227-4067-993e-38587c773df5 None admin] RBAC: Adding query filter params (name=service) {{(pid=87276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:29:14.713770 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b37c2d-0227-4067-993e-38587c773df5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:29:14.715339 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b37c2d-0227-4067-993e-38587c773df5 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:29:14.725259 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 429/857] 10.222.0.104 () {56 vars in 1108 bytes} [Tue Aug 9 16:29:14 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:29:14.732003 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68128de-bdc7-4331-9366-b74c5adf65fd None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:29:14.827216 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:29:14.847237 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68128de-bdc7-4331-9366-b74c5adf65fd None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:29:14.890404 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9991dcba-3829-464a-8828-65ef2df71f11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:29:14.891248 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9991dcba-3829-464a-8828-65ef2df71f11 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:29:14.891611 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9991dcba-3829-464a-8828-65ef2df71f11 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:29:14.891987 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9991dcba-3829-464a-8828-65ef2df71f11 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:29:14.903774 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9991dcba-3829-464a-8828-65ef2df71f11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:29:14.905312 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9991dcba-3829-464a-8828-65ef2df71f11 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:29:14.923252 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application [None req-9991dcba-3829-464a-8828-65ef2df71f11 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 16:29:14.923252 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:29:14.923252 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:29:14.923252 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:29:14.923252 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:29:14.923252 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:29:14.923252 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:29:14.923252 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:29:14.923252 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:29:14.923252 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:29:14.923252 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:29:14.923252 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:29:14.923252 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 16:29:14.923252 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 16:29:14.923252 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 16:29:14.923252 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 16:29:14.924495 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:29:14.924495 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:29:14.924495 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:29:14.924495 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:29:14.924495 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:29:14.924495 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:29:14.924495 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:29:14.924495 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application with Lock( Aug 09 16:29:14.924495 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:29:14.924495 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:29:14.924495 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:29:14.924495 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:29:14.924495 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:29:14.924495 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:29:14.924495 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:29:14.924495 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:29:14.924495 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 16:29:14.925688 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 16:29:14.925688 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 16:29:14.925688 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Aug 09 16:29:14.925688 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 429/858] 10.222.0.104 () {56 vars in 1113 bytes} [Tue Aug 9 16:29:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 16:29:14.933482 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b37c2d-0227-4067-993e-38587c773df5 None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:29:15.044041 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b37c2d-0227-4067-993e-38587c773df5 None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:29:15.048639 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:29:15.087992 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150d1652-9f84-408c-87d0-aa78dd9c524d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:29:15.088589 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150d1652-9f84-408c-87d0-aa78dd9c524d None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:29:15.088917 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150d1652-9f84-408c-87d0-aa78dd9c524d None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:29:15.089234 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150d1652-9f84-408c-87d0-aa78dd9c524d None admin] PATH_INFO: `/v3/domains` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:29:15.089924 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150d1652-9f84-408c-87d0-aa78dd9c524d None admin] RBAC: Adding query filter params (name=Default) {{(pid=87276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:29:15.090238 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150d1652-9f84-408c-87d0-aa78dd9c524d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:29:15.091828 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150d1652-9f84-408c-87d0-aa78dd9c524d None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:29:15.105255 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 430/859] 10.222.0.104 () {56 vars in 1114 bytes} [Tue Aug 9 16:29:14 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:29:15.112185 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9991dcba-3829-464a-8828-65ef2df71f11 None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:29:15.222259 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9991dcba-3829-464a-8828-65ef2df71f11 None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:29:15.259043 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00ba267-8c52-4445-a29a-a0fdaccfb2db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:29:15.259728 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00ba267-8c52-4445-a29a-a0fdaccfb2db None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:29:15.259990 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00ba267-8c52-4445-a29a-a0fdaccfb2db None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:29:15.260263 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00ba267-8c52-4445-a29a-a0fdaccfb2db None admin] PATH_INFO: `/v3/users/placement` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:29:15.263451 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:29:15.269318 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00ba267-8c52-4445-a29a-a0fdaccfb2db None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:29:15.271212 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00ba267-8c52-4445-a29a-a0fdaccfb2db None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:29:15.283358 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application [None req-b00ba267-8c52-4445-a29a-a0fdaccfb2db None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 09 16:29:15.283358 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:29:15.283358 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:29:15.283358 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:29:15.283358 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:29:15.283358 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:29:15.283358 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:29:15.283358 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:29:15.283358 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:29:15.283358 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:29:15.283358 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:29:15.283358 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:29:15.283358 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 16:29:15.283358 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 16:29:15.283358 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 16:29:15.283358 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 16:29:15.284521 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:29:15.284521 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:29:15.284521 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 16:29:15.284521 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 16:29:15.284521 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 16:29:15.284521 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 16:29:15.284521 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:29:15.284521 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:29:15.284521 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:29:15.284521 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:29:15.284521 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:29:15.284521 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application with Lock( Aug 09 16:29:15.284521 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:29:15.284521 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:29:15.284521 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:29:15.284521 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:29:15.284521 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:29:15.284521 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:29:15.285606 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:29:15.285606 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:29:15.285606 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 16:29:15.285606 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 16:29:15.285606 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 16:29:15.285606 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 16:29:15.285606 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 16:29:15.285606 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 16:29:15.285606 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 09 16:29:15.285606 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Aug 09 16:29:15.285606 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 430/860] 10.222.0.104 () {56 vars in 1113 bytes} [Tue Aug 9 16:29:15 2022] GET /identity/v3/users/placement => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 16:29:15.291057 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150d1652-9f84-408c-87d0-aa78dd9c524d None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:29:15.409892 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150d1652-9f84-408c-87d0-aa78dd9c524d None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:29:15.448969 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13734316-26ec-46b2-b6e5-ef5a2db0bbe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:29:15.449577 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13734316-26ec-46b2-b6e5-ef5a2db0bbe5 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:29:15.449997 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13734316-26ec-46b2-b6e5-ef5a2db0bbe5 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:29:15.450281 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13734316-26ec-46b2-b6e5-ef5a2db0bbe5 None admin] PATH_INFO: `/v3/users` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:29:15.451669 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13734316-26ec-46b2-b6e5-ef5a2db0bbe5 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:29:15.451986 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13734316-26ec-46b2-b6e5-ef5a2db0bbe5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:29:15.453565 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13734316-26ec-46b2-b6e5-ef5a2db0bbe5 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:29:15.473877 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 431/861] 10.222.0.104 () {56 vars in 1148 bytes} [Tue Aug 9 16:29:15 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 380 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 16:29:15.479557 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00ba267-8c52-4445-a29a-a0fdaccfb2db None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:29:15.600583 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00ba267-8c52-4445-a29a-a0fdaccfb2db None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:29:15.638828 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ad105e-bc99-4126-bc55-2e5d1927971b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:29:15.639650 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ad105e-bc99-4126-bc55-2e5d1927971b None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:29:15.640061 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ad105e-bc99-4126-bc55-2e5d1927971b None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:29:15.640486 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ad105e-bc99-4126-bc55-2e5d1927971b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:29:15.707523 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:29:15.715993 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ad105e-bc99-4126-bc55-2e5d1927971b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:29:15.717740 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ad105e-bc99-4126-bc55-2e5d1927971b None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:29:15.839454 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 431/862] 10.222.0.104 () {58 vars in 1287 bytes} [Tue Aug 9 16:29:15 2022] GET /identity/v3/auth/tokens => generated 1873 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 09 16:29:15.845667 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13734316-26ec-46b2-b6e5-ef5a2db0bbe5 None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:29:15.876560 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:29:15.960093 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13734316-26ec-46b2-b6e5-ef5a2db0bbe5 None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:29:15.997188 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601b90f6-1e85-4202-90ef-b994fd35f450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:29:15.997830 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601b90f6-1e85-4202-90ef-b994fd35f450 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:29:15.998120 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601b90f6-1e85-4202-90ef-b994fd35f450 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:29:15.998394 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601b90f6-1e85-4202-90ef-b994fd35f450 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:29:16.008128 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601b90f6-1e85-4202-90ef-b994fd35f450 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:29:16.009548 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601b90f6-1e85-4202-90ef-b994fd35f450 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:29:16.026081 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application [None req-601b90f6-1e85-4202-90ef-b994fd35f450 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 16:29:16.026081 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:29:16.026081 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:29:16.026081 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:29:16.026081 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:29:16.026081 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:29:16.026081 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:29:16.026081 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:29:16.026081 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:29:16.026081 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:29:16.026081 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:29:16.026081 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:29:16.026081 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 16:29:16.026081 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 16:29:16.026081 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 16:29:16.026081 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 16:29:16.027350 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:29:16.027350 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:29:16.027350 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:29:16.027350 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:29:16.027350 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:29:16.027350 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:29:16.027350 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:29:16.027350 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application with Lock( Aug 09 16:29:16.027350 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:29:16.027350 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:29:16.027350 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:29:16.027350 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:29:16.027350 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:29:16.027350 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:29:16.027350 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:29:16.027350 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:29:16.027350 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 16:29:16.028485 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 16:29:16.028485 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 16:29:16.028485 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Aug 09 16:29:16.028485 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 432/863] 10.222.0.104 () {56 vars in 1113 bytes} [Tue Aug 9 16:29:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 16:29:16.034085 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ad105e-bc99-4126-bc55-2e5d1927971b None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:29:16.144086 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:29:16.151868 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ad105e-bc99-4126-bc55-2e5d1927971b None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:29:16.190111 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd4d160-f0cd-40cc-9e24-69dd8a9241d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:29:16.190787 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd4d160-f0cd-40cc-9e24-69dd8a9241d0 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:29:16.191104 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd4d160-f0cd-40cc-9e24-69dd8a9241d0 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:29:16.191445 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd4d160-f0cd-40cc-9e24-69dd8a9241d0 None admin] PATH_INFO: `/v3/domains` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:29:16.192185 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd4d160-f0cd-40cc-9e24-69dd8a9241d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:29:16.192559 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd4d160-f0cd-40cc-9e24-69dd8a9241d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:29:16.194047 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd4d160-f0cd-40cc-9e24-69dd8a9241d0 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:29:16.206830 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 432/864] 10.222.0.104 () {56 vars in 1114 bytes} [Tue Aug 9 16:29:16 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:29:16.212757 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601b90f6-1e85-4202-90ef-b994fd35f450 None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:29:16.302192 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:29:16.345118 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601b90f6-1e85-4202-90ef-b994fd35f450 None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:29:16.393469 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9474d9a-dfbc-4145-bf2d-76eb045e575e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:29:16.394226 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9474d9a-dfbc-4145-bf2d-76eb045e575e None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:29:16.394533 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9474d9a-dfbc-4145-bf2d-76eb045e575e None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:29:16.394831 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9474d9a-dfbc-4145-bf2d-76eb045e575e None admin] PATH_INFO: `/v3/projects/service` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:29:16.403096 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9474d9a-dfbc-4145-bf2d-76eb045e575e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:29:16.404568 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9474d9a-dfbc-4145-bf2d-76eb045e575e None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:29:16.419110 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application [None req-b9474d9a-dfbc-4145-bf2d-76eb045e575e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 16:29:16.419110 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:29:16.419110 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:29:16.419110 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:29:16.419110 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:29:16.419110 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:29:16.419110 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:29:16.419110 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:29:16.419110 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:29:16.419110 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:29:16.419110 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:29:16.419110 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:29:16.419110 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 16:29:16.419110 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 16:29:16.419110 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 16:29:16.421074 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 16:29:16.421074 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:29:16.421074 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:29:16.421074 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:29:16.421074 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:29:16.421074 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:29:16.421074 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:29:16.421074 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:29:16.421074 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application with Lock( Aug 09 16:29:16.421074 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:29:16.421074 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:29:16.421074 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:29:16.421074 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:29:16.421074 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:29:16.421074 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:29:16.421074 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:29:16.421074 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:29:16.423330 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 16:29:16.423330 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 16:29:16.423330 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 16:29:16.423330 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 16:29:16.423330 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 16:29:16.423330 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 16:29:16.423330 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 16:29:16.423330 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Aug 09 16:29:16.423330 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 433/865] 10.222.0.104 () {56 vars in 1116 bytes} [Tue Aug 9 16:29:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 16:29:16.426976 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd4d160-f0cd-40cc-9e24-69dd8a9241d0 None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:29:16.540101 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd4d160-f0cd-40cc-9e24-69dd8a9241d0 None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:29:16.576269 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbfbfd3-08a2-4495-b316-3c41c78f87b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:29:16.577385 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbfbfd3-08a2-4495-b316-3c41c78f87b0 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:29:16.577661 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbfbfd3-08a2-4495-b316-3c41c78f87b0 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:29:16.577956 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbfbfd3-08a2-4495-b316-3c41c78f87b0 None admin] PATH_INFO: `/v3/projects` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:29:16.578690 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbfbfd3-08a2-4495-b316-3c41c78f87b0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:29:16.578990 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbfbfd3-08a2-4495-b316-3c41c78f87b0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:29:16.580419 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbfbfd3-08a2-4495-b316-3c41c78f87b0 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:29:16.593540 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 433/866] 10.222.0.104 () {56 vars in 1153 bytes} [Tue Aug 9 16:29:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:29:16.599902 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9474d9a-dfbc-4145-bf2d-76eb045e575e None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:29:16.711775 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9474d9a-dfbc-4145-bf2d-76eb045e575e None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:29:16.745451 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59544f6-4365-4783-b86a-5603302c7a9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:29:16.746171 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59544f6-4365-4783-b86a-5603302c7a9a None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:29:16.746483 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59544f6-4365-4783-b86a-5603302c7a9a None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:29:16.746717 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59544f6-4365-4783-b86a-5603302c7a9a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:29:16.747434 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59544f6-4365-4783-b86a-5603302c7a9a None admin] RBAC: Adding query filter params (role.id=aa624ab843384e48873a8d5a72422836, scope.project.id=63557f0ff1ce4ae49899b4627bafd94e, user.id=cfd1352d64de487ca4675cbe113e919f) {{(pid=87276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:29:16.747738 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59544f6-4365-4783-b86a-5603302c7a9a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:29:16.749681 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59544f6-4365-4783-b86a-5603302c7a9a None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:29:16.751406 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:29:16.758078 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 434/867] 10.222.0.104 () {56 vars in 1379 bytes} [Tue Aug 9 16:29:16 2022] GET /identity/v3/role_assignments?user.id=cfd1352d64de487ca4675cbe113e919f&scope.project.id=63557f0ff1ce4ae49899b4627bafd94e&role.id=aa624ab843384e48873a8d5a72422836 => generated 610 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:29:19.470961 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51190ae9-b26a-4b02-84e4-6ef6b9d390a4 None None] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:29:19.471582 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51190ae9-b26a-4b02-84e4-6ef6b9d390a4 None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:29:19.471697 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51190ae9-b26a-4b02-84e4-6ef6b9d390a4 None None] PATH_INFO: `/` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:29:19.473268 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 434/868] 10.222.0.104 () {54 vars in 932 bytes} [Tue Aug 9 16:29:19 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:29:19.479927 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7029cc85-a8af-4947-9db7-d11bab8d78c1 None None] REQUEST_METHOD: `POST` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:29:19.480404 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7029cc85-a8af-4947-9db7-d11bab8d78c1 None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:29:19.480508 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7029cc85-a8af-4947-9db7-d11bab8d78c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:29:19.501636 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.auth.core [None req-7029cc85-a8af-4947-9db7-d11bab8d78c1 None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:29:19.502974 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.fernet_utils [None req-7029cc85-a8af-4947-9db7-d11bab8d78c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:29:19.574420 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 435/869] 10.222.0.104 () {58 vars in 1029 bytes} [Tue Aug 9 16:29:19 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 16:29:19.604775 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51190ae9-b26a-4b02-84e4-6ef6b9d390a4 None None] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:29:19.626887 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:29:19.725696 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51190ae9-b26a-4b02-84e4-6ef6b9d390a4 None None] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:29:19.764347 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01713f1a-0e24-479a-bd9e-466c8f8f7f94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:29:19.765229 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01713f1a-0e24-479a-bd9e-466c8f8f7f94 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:29:19.765333 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01713f1a-0e24-479a-bd9e-466c8f8f7f94 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:29:19.765525 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01713f1a-0e24-479a-bd9e-466c8f8f7f94 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:29:19.778606 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01713f1a-0e24-479a-bd9e-466c8f8f7f94 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 16:29:19.784143 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application [None req-01713f1a-0e24-479a-bd9e-466c8f8f7f94 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 16:29:19.784143 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:29:19.784143 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:29:19.784143 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:29:19.784143 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:29:19.784143 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:29:19.784143 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:29:19.784143 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:29:19.784143 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:29:19.784143 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:29:19.784143 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:29:19.784143 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:29:19.784143 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 16:29:19.784143 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 16:29:19.784143 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 16:29:19.784143 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 16:29:19.786287 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 16:29:19.786287 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 16:29:19.786287 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 16:29:19.786287 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 16:29:19.786287 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:29:19.786287 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:29:19.786287 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:29:19.786287 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:29:19.786287 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:29:19.786287 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:29:19.786287 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:29:19.786287 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application with Lock( Aug 09 16:29:19.786287 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:29:19.786287 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:29:19.786287 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:29:19.786287 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:29:19.787480 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:29:19.787480 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:29:19.787480 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:29:19.787480 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:29:19.787480 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 16:29:19.787480 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 16:29:19.787480 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 16:29:19.787480 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 16:29:19.787480 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 16:29:19.787480 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 16:29:19.787480 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 16:29:19.787480 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Aug 09 16:29:19.787480 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 435/870] 10.222.0.104 () {56 vars in 1101 bytes} [Tue Aug 9 16:29:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 16:29:19.791556 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7029cc85-a8af-4947-9db7-d11bab8d78c1 None None] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:29:19.906695 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7029cc85-a8af-4947-9db7-d11bab8d78c1 None None] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:29:19.936448 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:29:19.944490 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d4a485-57ed-4e3c-8cdb-e5aff76cfce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:29:19.945170 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d4a485-57ed-4e3c-8cdb-e5aff76cfce3 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:29:19.945398 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d4a485-57ed-4e3c-8cdb-e5aff76cfce3 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:29:19.945789 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d4a485-57ed-4e3c-8cdb-e5aff76cfce3 None admin] PATH_INFO: `/v3/roles` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:29:19.946593 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d4a485-57ed-4e3c-8cdb-e5aff76cfce3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:29:19.946896 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d4a485-57ed-4e3c-8cdb-e5aff76cfce3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:29:19.948284 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d4a485-57ed-4e3c-8cdb-e5aff76cfce3 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:29:19.957413 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 436/871] 10.222.0.104 () {56 vars in 1104 bytes} [Tue Aug 9 16:29:19 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:29:19.963221 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01713f1a-0e24-479a-bd9e-466c8f8f7f94 None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:29:20.055155 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:29:20.080283 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01713f1a-0e24-479a-bd9e-466c8f8f7f94 None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:29:20.120558 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4109522-3910-4454-8fc7-c337c44b959d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:29:20.121197 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4109522-3910-4454-8fc7-c337c44b959d None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:29:20.121479 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4109522-3910-4454-8fc7-c337c44b959d None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:29:20.121760 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4109522-3910-4454-8fc7-c337c44b959d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:29:20.132984 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4109522-3910-4454-8fc7-c337c44b959d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:29:20.134560 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4109522-3910-4454-8fc7-c337c44b959d None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:29:20.149205 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application [None req-f4109522-3910-4454-8fc7-c337c44b959d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 16:29:20.149205 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:29:20.149205 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:29:20.149205 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:29:20.149205 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:29:20.149205 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:29:20.149205 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:29:20.149205 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:29:20.149205 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:29:20.149205 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:29:20.149205 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:29:20.149205 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:29:20.149205 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 16:29:20.149205 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 16:29:20.149205 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 16:29:20.149205 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 16:29:20.150458 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:29:20.150458 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:29:20.150458 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:29:20.150458 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:29:20.150458 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:29:20.150458 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:29:20.150458 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:29:20.150458 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application with Lock( Aug 09 16:29:20.150458 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:29:20.150458 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:29:20.150458 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:29:20.150458 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:29:20.150458 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:29:20.150458 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:29:20.150458 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:29:20.150458 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:29:20.150458 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 16:29:20.151529 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 16:29:20.151529 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 16:29:20.151529 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Aug 09 16:29:20.151529 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 436/872] 10.222.0.104 () {56 vars in 1113 bytes} [Tue Aug 9 16:29:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 16:29:20.157789 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d4a485-57ed-4e3c-8cdb-e5aff76cfce3 None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:29:20.281388 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d4a485-57ed-4e3c-8cdb-e5aff76cfce3 None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:29:20.320989 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455529ae-8de3-4674-b92b-43e9f9b8f644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:29:20.321597 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455529ae-8de3-4674-b92b-43e9f9b8f644 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:29:20.321863 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455529ae-8de3-4674-b92b-43e9f9b8f644 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:29:20.322217 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455529ae-8de3-4674-b92b-43e9f9b8f644 None admin] PATH_INFO: `/v3/domains` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:29:20.322864 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455529ae-8de3-4674-b92b-43e9f9b8f644 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:29:20.323167 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455529ae-8de3-4674-b92b-43e9f9b8f644 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:29:20.324577 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455529ae-8de3-4674-b92b-43e9f9b8f644 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:29:20.338505 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 437/873] 10.222.0.104 () {56 vars in 1114 bytes} [Tue Aug 9 16:29:20 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 16:29:20.346147 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4109522-3910-4454-8fc7-c337c44b959d None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:29:20.467588 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4109522-3910-4454-8fc7-c337c44b959d None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:29:20.495767 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:29:20.505853 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223a1a4a-8cc5-42e3-9926-e4d26912ae8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:29:20.506779 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223a1a4a-8cc5-42e3-9926-e4d26912ae8e None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:29:20.507257 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223a1a4a-8cc5-42e3-9926-e4d26912ae8e None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:29:20.507640 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223a1a4a-8cc5-42e3-9926-e4d26912ae8e None admin] PATH_INFO: `/v3/users/placement` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:29:20.518815 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223a1a4a-8cc5-42e3-9926-e4d26912ae8e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:29:20.520514 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223a1a4a-8cc5-42e3-9926-e4d26912ae8e None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:29:20.536479 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application [None req-223a1a4a-8cc5-42e3-9926-e4d26912ae8e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 09 16:29:20.536479 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:29:20.536479 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:29:20.536479 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:29:20.536479 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:29:20.536479 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:29:20.536479 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:29:20.536479 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:29:20.536479 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:29:20.536479 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:29:20.536479 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:29:20.536479 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:29:20.536479 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 16:29:20.536479 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 16:29:20.536479 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 16:29:20.536479 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 16:29:20.537685 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:29:20.537685 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:29:20.537685 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 16:29:20.537685 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 16:29:20.537685 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 16:29:20.537685 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 16:29:20.537685 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:29:20.537685 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:29:20.537685 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:29:20.537685 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:29:20.537685 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:29:20.537685 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application with Lock( Aug 09 16:29:20.537685 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:29:20.537685 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:29:20.537685 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:29:20.537685 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:29:20.537685 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:29:20.537685 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:29:20.538920 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:29:20.538920 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:29:20.538920 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 16:29:20.538920 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 16:29:20.538920 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 16:29:20.538920 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 16:29:20.538920 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 16:29:20.538920 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 16:29:20.538920 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 09 16:29:20.538920 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Aug 09 16:29:20.538920 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 437/874] 10.222.0.104 () {56 vars in 1113 bytes} [Tue Aug 9 16:29:20 2022] GET /identity/v3/users/placement => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 16:29:20.544370 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455529ae-8de3-4674-b92b-43e9f9b8f644 None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:29:20.604547 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:29:20.661137 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455529ae-8de3-4674-b92b-43e9f9b8f644 None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:29:20.697283 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d33402-42d1-465c-a99e-00ff557fe0f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:29:20.697882 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d33402-42d1-465c-a99e-00ff557fe0f1 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:29:20.698192 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d33402-42d1-465c-a99e-00ff557fe0f1 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:29:20.698463 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d33402-42d1-465c-a99e-00ff557fe0f1 None admin] PATH_INFO: `/v3/users` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:29:20.699932 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d33402-42d1-465c-a99e-00ff557fe0f1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:29:20.699932 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d33402-42d1-465c-a99e-00ff557fe0f1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:29:20.700882 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d33402-42d1-465c-a99e-00ff557fe0f1 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:29:20.722884 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 438/875] 10.222.0.104 () {56 vars in 1148 bytes} [Tue Aug 9 16:29:20 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 380 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 16:29:20.728842 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223a1a4a-8cc5-42e3-9926-e4d26912ae8e None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:29:20.864671 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223a1a4a-8cc5-42e3-9926-e4d26912ae8e None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:29:20.911016 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fe66e3-ccbd-4060-8870-ff908efcf694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:29:20.911842 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fe66e3-ccbd-4060-8870-ff908efcf694 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:29:20.912341 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fe66e3-ccbd-4060-8870-ff908efcf694 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:29:20.912631 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fe66e3-ccbd-4060-8870-ff908efcf694 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:29:20.989995 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:29:21.004893 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fe66e3-ccbd-4060-8870-ff908efcf694 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:29:21.006393 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fe66e3-ccbd-4060-8870-ff908efcf694 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:29:21.125651 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 438/876] 10.222.0.104 () {58 vars in 1287 bytes} [Tue Aug 9 16:29:20 2022] GET /identity/v3/auth/tokens => generated 1873 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 09 16:29:21.126506 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d33402-42d1-465c-a99e-00ff557fe0f1 None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:29:21.230407 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d33402-42d1-465c-a99e-00ff557fe0f1 None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:29:21.241996 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:29:21.269506 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589c9bec-6aa2-456c-9363-2719a06e00af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:29:21.270240 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589c9bec-6aa2-456c-9363-2719a06e00af None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:29:21.270575 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589c9bec-6aa2-456c-9363-2719a06e00af None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:29:21.270961 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589c9bec-6aa2-456c-9363-2719a06e00af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:29:21.283512 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589c9bec-6aa2-456c-9363-2719a06e00af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:29:21.284999 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589c9bec-6aa2-456c-9363-2719a06e00af None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:29:21.301441 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application [None req-589c9bec-6aa2-456c-9363-2719a06e00af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 16:29:21.301441 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:29:21.301441 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:29:21.301441 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:29:21.301441 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:29:21.301441 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:29:21.301441 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:29:21.301441 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:29:21.301441 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:29:21.301441 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:29:21.301441 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:29:21.301441 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:29:21.301441 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 16:29:21.301441 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 16:29:21.301441 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 16:29:21.301441 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 16:29:21.302600 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:29:21.302600 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:29:21.302600 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:29:21.302600 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:29:21.302600 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:29:21.302600 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:29:21.302600 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:29:21.302600 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application with Lock( Aug 09 16:29:21.302600 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:29:21.302600 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:29:21.302600 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:29:21.302600 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:29:21.302600 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:29:21.302600 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:29:21.302600 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:29:21.302600 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:29:21.302600 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 16:29:21.303490 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 16:29:21.303490 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 16:29:21.303490 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Aug 09 16:29:21.303490 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 439/877] 10.222.0.104 () {56 vars in 1113 bytes} [Tue Aug 9 16:29:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 16:29:21.310580 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fe66e3-ccbd-4060-8870-ff908efcf694 None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:29:21.420662 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:29:21.439356 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fe66e3-ccbd-4060-8870-ff908efcf694 None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:29:21.475514 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4396be02-1d63-463d-a1b5-f4f50ba90304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:29:21.476179 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4396be02-1d63-463d-a1b5-f4f50ba90304 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:29:21.476533 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4396be02-1d63-463d-a1b5-f4f50ba90304 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:29:21.476859 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4396be02-1d63-463d-a1b5-f4f50ba90304 None admin] PATH_INFO: `/v3/domains` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:29:21.477463 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4396be02-1d63-463d-a1b5-f4f50ba90304 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:29:21.477791 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4396be02-1d63-463d-a1b5-f4f50ba90304 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:29:21.479331 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4396be02-1d63-463d-a1b5-f4f50ba90304 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:29:21.491694 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 439/878] 10.222.0.104 () {56 vars in 1114 bytes} [Tue Aug 9 16:29:21 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:29:21.497430 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589c9bec-6aa2-456c-9363-2719a06e00af None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:29:21.611582 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589c9bec-6aa2-456c-9363-2719a06e00af None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:29:21.647706 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550824c7-4364-4787-ab1f-3d5948c2dc24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:29:21.648337 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550824c7-4364-4787-ab1f-3d5948c2dc24 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:29:21.648613 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550824c7-4364-4787-ab1f-3d5948c2dc24 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:29:21.648891 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550824c7-4364-4787-ab1f-3d5948c2dc24 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:29:21.655884 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550824c7-4364-4787-ab1f-3d5948c2dc24 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:29:21.657882 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550824c7-4364-4787-ab1f-3d5948c2dc24 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:29:21.672629 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application [None req-550824c7-4364-4787-ab1f-3d5948c2dc24 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 16:29:21.672629 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:29:21.672629 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:29:21.672629 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:29:21.672629 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:29:21.672629 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:29:21.672629 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:29:21.672629 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:29:21.672629 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:29:21.672629 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:29:21.672629 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:29:21.672629 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:29:21.672629 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 16:29:21.672629 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 16:29:21.672629 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 16:29:21.673820 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 16:29:21.673820 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:29:21.673820 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:29:21.673820 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:29:21.673820 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:29:21.673820 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:29:21.673820 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:29:21.673820 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:29:21.673820 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application with Lock( Aug 09 16:29:21.673820 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:29:21.673820 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:29:21.673820 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:29:21.673820 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:29:21.673820 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:29:21.673820 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:29:21.673820 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:29:21.673820 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:29:21.675116 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 16:29:21.675116 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 16:29:21.675116 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 16:29:21.675116 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 16:29:21.675116 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 16:29:21.675116 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 16:29:21.675116 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 16:29:21.675116 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Aug 09 16:29:21.675116 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 440/879] 10.222.0.104 () {56 vars in 1116 bytes} [Tue Aug 9 16:29:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 16:29:21.679967 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4396be02-1d63-463d-a1b5-f4f50ba90304 None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:29:21.792241 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4396be02-1d63-463d-a1b5-f4f50ba90304 None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:29:21.829240 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e7ab69-4842-48ba-b08c-0745bdee95a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:29:21.829932 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e7ab69-4842-48ba-b08c-0745bdee95a6 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:29:21.830289 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e7ab69-4842-48ba-b08c-0745bdee95a6 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:29:21.830563 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e7ab69-4842-48ba-b08c-0745bdee95a6 None admin] PATH_INFO: `/v3/projects` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:29:21.831296 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e7ab69-4842-48ba-b08c-0745bdee95a6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:29:21.831671 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e7ab69-4842-48ba-b08c-0745bdee95a6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:29:21.833145 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e7ab69-4842-48ba-b08c-0745bdee95a6 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:29:21.851490 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 440/880] 10.222.0.104 () {56 vars in 1153 bytes} [Tue Aug 9 16:29:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:29:21.852763 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550824c7-4364-4787-ab1f-3d5948c2dc24 None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:29:21.877199 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:29:21.970629 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550824c7-4364-4787-ab1f-3d5948c2dc24 None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:29:22.005474 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7625a7c7-5148-4641-be70-b35ae13fbf5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:29:22.006137 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7625a7c7-5148-4641-be70-b35ae13fbf5c None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:29:22.006530 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7625a7c7-5148-4641-be70-b35ae13fbf5c None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:29:22.006638 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7625a7c7-5148-4641-be70-b35ae13fbf5c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:29:22.007369 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7625a7c7-5148-4641-be70-b35ae13fbf5c None admin] RBAC: Adding query filter params (role.id=c0143e35c1344a39a931bbb6bcd5acdc, scope.project.id=63557f0ff1ce4ae49899b4627bafd94e, user.id=cfd1352d64de487ca4675cbe113e919f) {{(pid=87276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:29:22.007639 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7625a7c7-5148-4641-be70-b35ae13fbf5c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:29:22.009086 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7625a7c7-5148-4641-be70-b35ae13fbf5c None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:29:22.014509 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 441/881] 10.222.0.104 () {56 vars in 1379 bytes} [Tue Aug 9 16:29:21 2022] GET /identity/v3/role_assignments?user.id=cfd1352d64de487ca4675cbe113e919f&scope.project.id=63557f0ff1ce4ae49899b4627bafd94e&role.id=c0143e35c1344a39a931bbb6bcd5acdc => generated 260 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:29:24.312714 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d53821-8b4a-4caa-8b77-6246df73c13f None None] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:29:24.313383 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d53821-8b4a-4caa-8b77-6246df73c13f None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:29:24.313383 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d53821-8b4a-4caa-8b77-6246df73c13f None None] PATH_INFO: `/` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:29:24.315245 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 441/882] 10.222.0.104 () {54 vars in 932 bytes} [Tue Aug 9 16:29:24 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:29:24.320872 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f6fb63-be85-43ad-ab4c-20dda140e041 None None] REQUEST_METHOD: `POST` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:29:24.321337 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f6fb63-be85-43ad-ab4c-20dda140e041 None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:29:24.321432 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f6fb63-be85-43ad-ab4c-20dda140e041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:29:24.346759 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.auth.core [None req-f1f6fb63-be85-43ad-ab4c-20dda140e041 None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:29:24.348812 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.fernet_utils [None req-f1f6fb63-be85-43ad-ab4c-20dda140e041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:29:24.429225 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 442/883] 10.222.0.104 () {58 vars in 1029 bytes} [Tue Aug 9 16:29:24 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 16:29:24.452982 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d53821-8b4a-4caa-8b77-6246df73c13f None None] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:29:24.464233 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:29:24.554221 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d53821-8b4a-4caa-8b77-6246df73c13f None None] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:29:24.586412 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9812084f-2446-4854-8b1c-2b92df319518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:29:24.586983 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9812084f-2446-4854-8b1c-2b92df319518 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:29:24.587255 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9812084f-2446-4854-8b1c-2b92df319518 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:29:24.587520 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9812084f-2446-4854-8b1c-2b92df319518 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:29:24.597341 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9812084f-2446-4854-8b1c-2b92df319518 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 16:29:24.601982 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application [None req-9812084f-2446-4854-8b1c-2b92df319518 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 16:29:24.601982 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:29:24.601982 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:29:24.601982 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:29:24.601982 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:29:24.601982 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:29:24.601982 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:29:24.601982 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:29:24.601982 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:29:24.601982 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:29:24.601982 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:29:24.601982 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:29:24.601982 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 16:29:24.601982 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 16:29:24.601982 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 16:29:24.601982 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 16:29:24.602943 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 16:29:24.602943 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 16:29:24.602943 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 16:29:24.602943 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 16:29:24.602943 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:29:24.602943 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:29:24.602943 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:29:24.602943 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:29:24.602943 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:29:24.602943 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:29:24.602943 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:29:24.602943 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application with Lock( Aug 09 16:29:24.602943 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:29:24.602943 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:29:24.602943 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:29:24.602943 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:29:24.604048 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:29:24.604048 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:29:24.604048 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:29:24.604048 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:29:24.604048 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 16:29:24.604048 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 16:29:24.604048 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 16:29:24.604048 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 16:29:24.604048 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 16:29:24.604048 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 16:29:24.604048 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 16:29:24.604048 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Aug 09 16:29:24.604048 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 442/884] 10.222.0.104 () {56 vars in 1101 bytes} [Tue Aug 9 16:29:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 16:29:24.609067 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f6fb63-be85-43ad-ab4c-20dda140e041 None None] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:29:24.624472 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:29:24.712723 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f6fb63-be85-43ad-ab4c-20dda140e041 None None] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:29:24.746301 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e174c0-b02c-477a-a361-dffa17298d6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:29:24.746881 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e174c0-b02c-477a-a361-dffa17298d6a None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:29:24.747159 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e174c0-b02c-477a-a361-dffa17298d6a None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:29:24.747427 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e174c0-b02c-477a-a361-dffa17298d6a None admin] PATH_INFO: `/v3/roles` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:29:24.748077 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e174c0-b02c-477a-a361-dffa17298d6a None admin] RBAC: Adding query filter params (name=admin) {{(pid=87276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:29:24.748379 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e174c0-b02c-477a-a361-dffa17298d6a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:29:24.749735 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e174c0-b02c-477a-a361-dffa17298d6a None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:29:24.757473 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 443/885] 10.222.0.104 () {56 vars in 1104 bytes} [Tue Aug 9 16:29:24 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:29:24.763251 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9812084f-2446-4854-8b1c-2b92df319518 None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:29:24.828320 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:29:24.861167 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9812084f-2446-4854-8b1c-2b92df319518 None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:29:24.893105 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6199a23-44b7-4dec-8768-21e1ee526dfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:29:24.893717 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6199a23-44b7-4dec-8768-21e1ee526dfd None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:29:24.894014 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6199a23-44b7-4dec-8768-21e1ee526dfd None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:29:24.894281 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6199a23-44b7-4dec-8768-21e1ee526dfd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:29:24.903825 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6199a23-44b7-4dec-8768-21e1ee526dfd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:29:24.905265 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6199a23-44b7-4dec-8768-21e1ee526dfd None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:29:24.919476 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application [None req-b6199a23-44b7-4dec-8768-21e1ee526dfd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 16:29:24.919476 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:29:24.919476 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:29:24.919476 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:29:24.919476 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:29:24.919476 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:29:24.919476 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:29:24.919476 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:29:24.919476 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:29:24.919476 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:29:24.919476 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:29:24.919476 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:29:24.919476 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 16:29:24.919476 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 16:29:24.919476 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 16:29:24.919476 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 16:29:24.920570 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:29:24.920570 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:29:24.920570 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:29:24.920570 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:29:24.920570 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:29:24.920570 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:29:24.920570 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:29:24.920570 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application with Lock( Aug 09 16:29:24.920570 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:29:24.920570 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:29:24.920570 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:29:24.920570 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:29:24.920570 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:29:24.920570 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:29:24.920570 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:29:24.920570 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:29:24.920570 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 16:29:24.921561 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 16:29:24.921561 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 16:29:24.921561 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Aug 09 16:29:24.921561 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 443/886] 10.222.0.104 () {56 vars in 1113 bytes} [Tue Aug 9 16:29:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 16:29:24.926590 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e174c0-b02c-477a-a361-dffa17298d6a None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:29:25.000234 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:29:25.022988 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e174c0-b02c-477a-a361-dffa17298d6a None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:29:25.054634 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de241fac-13bc-4df0-adfa-b3e7c88659d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:29:25.055221 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de241fac-13bc-4df0-adfa-b3e7c88659d0 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:29:25.055496 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de241fac-13bc-4df0-adfa-b3e7c88659d0 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:29:25.055763 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de241fac-13bc-4df0-adfa-b3e7c88659d0 None admin] PATH_INFO: `/v3/domains` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:29:25.056385 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de241fac-13bc-4df0-adfa-b3e7c88659d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:29:25.056686 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de241fac-13bc-4df0-adfa-b3e7c88659d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:29:25.058059 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de241fac-13bc-4df0-adfa-b3e7c88659d0 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:29:25.070287 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 444/887] 10.222.0.104 () {56 vars in 1114 bytes} [Tue Aug 9 16:29:24 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:29:25.076097 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6199a23-44b7-4dec-8768-21e1ee526dfd None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:29:25.172253 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6199a23-44b7-4dec-8768-21e1ee526dfd None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:29:25.192044 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:29:25.206071 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e9b782-86d5-4f4d-bc2d-0c55e06bc52f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:29:25.206685 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e9b782-86d5-4f4d-bc2d-0c55e06bc52f None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:29:25.206962 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e9b782-86d5-4f4d-bc2d-0c55e06bc52f None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:29:25.207233 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e9b782-86d5-4f4d-bc2d-0c55e06bc52f None admin] PATH_INFO: `/v3/users/placement` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:29:25.214354 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e9b782-86d5-4f4d-bc2d-0c55e06bc52f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:29:25.215777 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e9b782-86d5-4f4d-bc2d-0c55e06bc52f None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:29:25.226990 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application [None req-42e9b782-86d5-4f4d-bc2d-0c55e06bc52f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 09 16:29:25.226990 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:29:25.226990 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:29:25.226990 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:29:25.226990 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:29:25.226990 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:29:25.226990 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:29:25.226990 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:29:25.226990 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:29:25.226990 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:29:25.226990 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:29:25.226990 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:29:25.226990 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 16:29:25.226990 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 16:29:25.226990 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 16:29:25.226990 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 16:29:25.228076 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:29:25.228076 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:29:25.228076 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 16:29:25.228076 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 16:29:25.228076 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 16:29:25.228076 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 16:29:25.228076 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:29:25.228076 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:29:25.228076 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:29:25.228076 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:29:25.228076 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:29:25.228076 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application with Lock( Aug 09 16:29:25.228076 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:29:25.228076 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:29:25.228076 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:29:25.228076 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:29:25.228076 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:29:25.228076 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:29:25.228998 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:29:25.228998 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:29:25.228998 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 16:29:25.228998 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 16:29:25.228998 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 16:29:25.228998 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 16:29:25.228998 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 16:29:25.228998 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 16:29:25.228998 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 09 16:29:25.228998 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Aug 09 16:29:25.228998 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 444/888] 10.222.0.104 () {56 vars in 1113 bytes} [Tue Aug 9 16:29:25 2022] GET /identity/v3/users/placement => generated 87 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 16:29:25.233960 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de241fac-13bc-4df0-adfa-b3e7c88659d0 None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:29:25.337331 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de241fac-13bc-4df0-adfa-b3e7c88659d0 None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:29:25.372589 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e29793-b932-424b-ad29-7374a3b6edfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:29:25.373189 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e29793-b932-424b-ad29-7374a3b6edfd None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:29:25.373462 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e29793-b932-424b-ad29-7374a3b6edfd None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:29:25.373729 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e29793-b932-424b-ad29-7374a3b6edfd None admin] PATH_INFO: `/v3/users` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:29:25.374478 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e29793-b932-424b-ad29-7374a3b6edfd None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:29:25.374778 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e29793-b932-424b-ad29-7374a3b6edfd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:29:25.376188 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e29793-b932-424b-ad29-7374a3b6edfd None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:29:25.378716 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:29:25.393431 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 445/889] 10.222.0.104 () {56 vars in 1148 bytes} [Tue Aug 9 16:29:25 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 380 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:29:25.399293 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e9b782-86d5-4f4d-bc2d-0c55e06bc52f None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:29:25.496249 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e9b782-86d5-4f4d-bc2d-0c55e06bc52f None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:29:25.530627 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa27b0a4-18b0-493c-898e-6b65ae774086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:29:25.531245 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa27b0a4-18b0-493c-898e-6b65ae774086 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:29:25.531517 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa27b0a4-18b0-493c-898e-6b65ae774086 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:29:25.531782 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa27b0a4-18b0-493c-898e-6b65ae774086 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:29:25.542812 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa27b0a4-18b0-493c-898e-6b65ae774086 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:29:25.544235 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa27b0a4-18b0-493c-898e-6b65ae774086 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:29:25.557802 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application [None req-fa27b0a4-18b0-493c-898e-6b65ae774086 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 16:29:25.557802 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:29:25.557802 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:29:25.557802 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:29:25.557802 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:29:25.557802 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:29:25.557802 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:29:25.557802 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:29:25.557802 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:29:25.557802 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:29:25.557802 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:29:25.557802 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:29:25.557802 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 16:29:25.557802 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 16:29:25.557802 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 16:29:25.557802 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 16:29:25.558926 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:29:25.558926 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:29:25.558926 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:29:25.558926 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:29:25.558926 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:29:25.558926 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:29:25.558926 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:29:25.558926 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application with Lock( Aug 09 16:29:25.558926 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:29:25.558926 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:29:25.558926 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:29:25.558926 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:29:25.558926 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:29:25.558926 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:29:25.558926 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:29:25.558926 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:29:25.558926 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 16:29:25.559847 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 16:29:25.559847 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 16:29:25.559847 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Aug 09 16:29:25.559847 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 445/890] 10.222.0.104 () {56 vars in 1113 bytes} [Tue Aug 9 16:29:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 16:29:25.564896 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e29793-b932-424b-ad29-7374a3b6edfd None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:29:25.660279 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e29793-b932-424b-ad29-7374a3b6edfd None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:29:25.693378 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07620172-227a-4a81-8acb-def61589cc6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:29:25.694000 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07620172-227a-4a81-8acb-def61589cc6c None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:29:25.694279 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07620172-227a-4a81-8acb-def61589cc6c None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:29:25.694552 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07620172-227a-4a81-8acb-def61589cc6c None admin] PATH_INFO: `/v3/domains` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:29:25.695178 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07620172-227a-4a81-8acb-def61589cc6c None admin] RBAC: Adding query filter params (name=Default) {{(pid=87276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:29:25.695483 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07620172-227a-4a81-8acb-def61589cc6c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:29:25.696840 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07620172-227a-4a81-8acb-def61589cc6c None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:29:25.708800 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 446/891] 10.222.0.104 () {56 vars in 1114 bytes} [Tue Aug 9 16:29:25 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:29:25.714579 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa27b0a4-18b0-493c-898e-6b65ae774086 None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:29:25.745356 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:29:25.812965 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa27b0a4-18b0-493c-898e-6b65ae774086 None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:29:25.845107 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa12ad5-fed3-4d3c-b8b4-4fde51eee693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:29:25.845738 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa12ad5-fed3-4d3c-b8b4-4fde51eee693 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:29:25.846040 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa12ad5-fed3-4d3c-b8b4-4fde51eee693 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:29:25.846311 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa12ad5-fed3-4d3c-b8b4-4fde51eee693 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:29:25.852590 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa12ad5-fed3-4d3c-b8b4-4fde51eee693 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:29:25.854042 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa12ad5-fed3-4d3c-b8b4-4fde51eee693 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:29:25.864625 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application [None req-0fa12ad5-fed3-4d3c-b8b4-4fde51eee693 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 16:29:25.864625 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:29:25.864625 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:29:25.864625 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:29:25.864625 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:29:25.864625 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:29:25.864625 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:29:25.864625 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:29:25.864625 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:29:25.864625 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:29:25.864625 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:29:25.864625 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:29:25.864625 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 16:29:25.864625 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 16:29:25.864625 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 16:29:25.865542 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 16:29:25.865542 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:29:25.865542 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:29:25.865542 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:29:25.865542 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:29:25.865542 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:29:25.865542 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:29:25.865542 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:29:25.865542 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application with Lock( Aug 09 16:29:25.865542 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:29:25.865542 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:29:25.865542 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:29:25.865542 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:29:25.865542 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:29:25.865542 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:29:25.865542 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:29:25.865542 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:29:25.866631 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 16:29:25.866631 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 16:29:25.866631 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 16:29:25.866631 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 16:29:25.866631 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 16:29:25.866631 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 16:29:25.866631 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 16:29:25.866631 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Aug 09 16:29:25.866631 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 446/892] 10.222.0.104 () {56 vars in 1116 bytes} [Tue Aug 9 16:29:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 16:29:25.871842 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07620172-227a-4a81-8acb-def61589cc6c None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:29:25.926037 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:29:25.970465 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07620172-227a-4a81-8acb-def61589cc6c None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:29:26.002950 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0bf3f6-ffe7-4227-9b99-0ebb0491d17c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:29:26.003542 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0bf3f6-ffe7-4227-9b99-0ebb0491d17c None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:29:26.003821 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0bf3f6-ffe7-4227-9b99-0ebb0491d17c None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:29:26.004092 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0bf3f6-ffe7-4227-9b99-0ebb0491d17c None admin] PATH_INFO: `/v3/projects` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:29:26.004772 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0bf3f6-ffe7-4227-9b99-0ebb0491d17c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:29:26.005077 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0bf3f6-ffe7-4227-9b99-0ebb0491d17c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:29:26.006553 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0bf3f6-ffe7-4227-9b99-0ebb0491d17c None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:29:26.018551 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 447/893] 10.222.0.104 () {56 vars in 1153 bytes} [Tue Aug 9 16:29:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:29:26.024490 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa12ad5-fed3-4d3c-b8b4-4fde51eee693 None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:29:26.115655 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:29:26.124811 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa12ad5-fed3-4d3c-b8b4-4fde51eee693 None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:29:26.157157 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac73d26-20b8-40f0-8957-c34ca794fbc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:29:26.157826 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac73d26-20b8-40f0-8957-c34ca794fbc9 None admin] REQUEST_METHOD: `PUT` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:29:26.158135 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac73d26-20b8-40f0-8957-c34ca794fbc9 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:29:26.158408 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac73d26-20b8-40f0-8957-c34ca794fbc9 None admin] PATH_INFO: `/v3/projects/63557f0ff1ce4ae49899b4627bafd94e/users/cfd1352d64de487ca4675cbe113e919f/roles/c0143e35c1344a39a931bbb6bcd5acdc` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:29:26.160291 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac73d26-20b8-40f0-8957-c34ca794fbc9 None admin] RBAC: Authorizing `identity:create_grant(project_id=63557f0ff1ce4ae49899b4627bafd94e, user_id=cfd1352d64de487ca4675cbe113e919f, role_id=c0143e35c1344a39a931bbb6bcd5acdc)` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:29:26.161730 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac73d26-20b8-40f0-8957-c34ca794fbc9 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:29:26.175495 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 447/894] 10.222.0.104 () {58 vars in 1444 bytes} [Tue Aug 9 16:29:26 2022] PUT /identity/v3/projects/63557f0ff1ce4ae49899b4627bafd94e/users/cfd1352d64de487ca4675cbe113e919f/roles/c0143e35c1344a39a931bbb6bcd5acdc => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 16:29:28.447790 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18319c2a-6565-4030-926f-6657cde1e371 None None] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:29:28.448313 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18319c2a-6565-4030-926f-6657cde1e371 None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:29:28.448313 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18319c2a-6565-4030-926f-6657cde1e371 None None] PATH_INFO: `/` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:29:28.449649 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 448/895] 10.222.0.104 () {54 vars in 932 bytes} [Tue Aug 9 16:29:28 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:29:28.454862 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ba5428-9d2b-48dc-8499-16a396341d6c None None] REQUEST_METHOD: `POST` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:29:28.455244 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ba5428-9d2b-48dc-8499-16a396341d6c None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:29:28.455891 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ba5428-9d2b-48dc-8499-16a396341d6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:29:28.474439 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.auth.core [None req-48ba5428-9d2b-48dc-8499-16a396341d6c None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:29:28.475730 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.fernet_utils [None req-48ba5428-9d2b-48dc-8499-16a396341d6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:29:28.538714 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 448/896] 10.222.0.104 () {58 vars in 1029 bytes} [Tue Aug 9 16:29:28 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 16:29:28.562888 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18319c2a-6565-4030-926f-6657cde1e371 None None] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:29:28.663711 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18319c2a-6565-4030-926f-6657cde1e371 None None] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:29:28.678085 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:29:28.698729 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acc4be0-c209-4ff1-91af-33d08b3a145f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:29:28.699288 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acc4be0-c209-4ff1-91af-33d08b3a145f None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:29:28.699565 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acc4be0-c209-4ff1-91af-33d08b3a145f None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:29:28.699842 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acc4be0-c209-4ff1-91af-33d08b3a145f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:29:28.710218 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acc4be0-c209-4ff1-91af-33d08b3a145f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 16:29:28.714909 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application [None req-3acc4be0-c209-4ff1-91af-33d08b3a145f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 16:29:28.714909 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:29:28.714909 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:29:28.714909 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:29:28.714909 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:29:28.714909 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:29:28.714909 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:29:28.714909 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:29:28.714909 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:29:28.714909 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:29:28.714909 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:29:28.714909 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:29:28.714909 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 16:29:28.714909 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 16:29:28.714909 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 16:29:28.714909 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 16:29:28.715990 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 16:29:28.715990 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 16:29:28.715990 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 16:29:28.715990 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 16:29:28.715990 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:29:28.715990 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:29:28.715990 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:29:28.715990 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:29:28.715990 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:29:28.715990 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:29:28.715990 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:29:28.715990 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application with Lock( Aug 09 16:29:28.715990 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:29:28.715990 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:29:28.715990 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:29:28.715990 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:29:28.717029 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:29:28.717029 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:29:28.717029 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:29:28.717029 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:29:28.717029 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 16:29:28.717029 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 16:29:28.717029 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 16:29:28.717029 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 16:29:28.717029 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 16:29:28.717029 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 16:29:28.717029 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 16:29:28.717029 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Aug 09 16:29:28.717029 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 449/897] 10.222.0.104 () {56 vars in 1101 bytes} [Tue Aug 9 16:29:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 16:29:28.722083 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ba5428-9d2b-48dc-8499-16a396341d6c None None] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:29:28.800262 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:29:28.820609 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ba5428-9d2b-48dc-8499-16a396341d6c None None] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:29:28.854860 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78c89f1-9a94-4a70-bb5d-ddf79720795e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:29:28.855494 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78c89f1-9a94-4a70-bb5d-ddf79720795e None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:29:28.855773 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78c89f1-9a94-4a70-bb5d-ddf79720795e None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:29:28.856045 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78c89f1-9a94-4a70-bb5d-ddf79720795e None admin] PATH_INFO: `/v3/roles` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:29:28.856704 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78c89f1-9a94-4a70-bb5d-ddf79720795e None admin] RBAC: Adding query filter params (name=admin) {{(pid=87275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:29:28.857008 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78c89f1-9a94-4a70-bb5d-ddf79720795e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:29:28.858404 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78c89f1-9a94-4a70-bb5d-ddf79720795e None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:29:28.866367 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 449/898] 10.222.0.104 () {56 vars in 1104 bytes} [Tue Aug 9 16:29:28 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:29:28.872152 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acc4be0-c209-4ff1-91af-33d08b3a145f None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:29:28.968931 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acc4be0-c209-4ff1-91af-33d08b3a145f None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:29:29.000451 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cd850d-80b6-4299-b2ea-5210851360fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:29:29.001055 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cd850d-80b6-4299-b2ea-5210851360fb None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:29:29.001329 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cd850d-80b6-4299-b2ea-5210851360fb None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:29:29.001595 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cd850d-80b6-4299-b2ea-5210851360fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:29:29.012145 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cd850d-80b6-4299-b2ea-5210851360fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:29:29.013560 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cd850d-80b6-4299-b2ea-5210851360fb None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:29:29.027588 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application [None req-58cd850d-80b6-4299-b2ea-5210851360fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 16:29:29.027588 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:29:29.027588 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:29:29.027588 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:29:29.027588 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:29:29.027588 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:29:29.027588 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:29:29.027588 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:29:29.027588 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:29:29.027588 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:29:29.027588 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:29:29.027588 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:29:29.027588 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 16:29:29.027588 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 16:29:29.027588 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 16:29:29.027588 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 16:29:29.028692 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:29:29.028692 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:29:29.028692 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:29:29.028692 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:29:29.028692 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:29:29.028692 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:29:29.028692 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:29:29.028692 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application with Lock( Aug 09 16:29:29.028692 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:29:29.028692 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:29:29.028692 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:29:29.028692 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:29:29.028692 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:29:29.028692 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:29:29.028692 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:29:29.028692 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:29:29.028692 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 16:29:29.029775 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 16:29:29.029775 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 16:29:29.029775 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Aug 09 16:29:29.029775 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 450/899] 10.222.0.104 () {56 vars in 1113 bytes} [Tue Aug 9 16:29:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 16:29:29.034387 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78c89f1-9a94-4a70-bb5d-ddf79720795e None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:29:29.131192 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78c89f1-9a94-4a70-bb5d-ddf79720795e None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:29:29.162716 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f953a27-98fb-41bd-bd45-d0c6124e9a02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:29:29.163306 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f953a27-98fb-41bd-bd45-d0c6124e9a02 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:29:29.163584 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f953a27-98fb-41bd-bd45-d0c6124e9a02 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:29:29.163853 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f953a27-98fb-41bd-bd45-d0c6124e9a02 None admin] PATH_INFO: `/v3/domains` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:29:29.164476 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f953a27-98fb-41bd-bd45-d0c6124e9a02 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:29:29.164775 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f953a27-98fb-41bd-bd45-d0c6124e9a02 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:29:29.166151 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f953a27-98fb-41bd-bd45-d0c6124e9a02 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:29:29.178774 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 450/900] 10.222.0.104 () {56 vars in 1114 bytes} [Tue Aug 9 16:29:29 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:29:29.184424 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cd850d-80b6-4299-b2ea-5210851360fb None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:29:29.212005 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:29:29.281442 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cd850d-80b6-4299-b2ea-5210851360fb None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:29:29.314858 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98be6df-cc16-4ed0-be91-a520e3ece1aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:29:29.315511 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98be6df-cc16-4ed0-be91-a520e3ece1aa None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:29:29.315793 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98be6df-cc16-4ed0-be91-a520e3ece1aa None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:29:29.316125 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98be6df-cc16-4ed0-be91-a520e3ece1aa None admin] PATH_INFO: `/v3/users/placement` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:29:29.324096 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98be6df-cc16-4ed0-be91-a520e3ece1aa None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:29:29.325563 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98be6df-cc16-4ed0-be91-a520e3ece1aa None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:29:29.338554 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application [None req-d98be6df-cc16-4ed0-be91-a520e3ece1aa None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 09 16:29:29.338554 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:29:29.338554 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:29:29.338554 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:29:29.338554 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:29:29.338554 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:29:29.338554 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:29:29.338554 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:29:29.338554 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:29:29.338554 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:29:29.338554 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:29:29.338554 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:29:29.338554 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 16:29:29.338554 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 16:29:29.338554 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 16:29:29.338554 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 16:29:29.340087 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:29:29.340087 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:29:29.340087 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 16:29:29.340087 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 16:29:29.340087 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 16:29:29.340087 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 16:29:29.340087 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:29:29.340087 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:29:29.340087 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:29:29.340087 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:29:29.340087 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:29:29.340087 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application with Lock( Aug 09 16:29:29.340087 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:29:29.340087 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:29:29.340087 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:29:29.340087 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:29:29.340087 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:29:29.340087 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:29:29.341022 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:29:29.341022 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:29:29.341022 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 16:29:29.341022 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 16:29:29.341022 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 16:29:29.341022 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 16:29:29.341022 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 16:29:29.341022 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 16:29:29.341022 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 09 16:29:29.341022 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Aug 09 16:29:29.341022 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 451/901] 10.222.0.104 () {56 vars in 1113 bytes} [Tue Aug 9 16:29:29 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 16:29:29.346312 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f953a27-98fb-41bd-bd45-d0c6124e9a02 None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:29:29.351330 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:29:29.450491 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f953a27-98fb-41bd-bd45-d0c6124e9a02 None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:29:29.482709 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec99a94-2c7d-4896-a07f-ee94f3e8f0fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:29:29.483302 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec99a94-2c7d-4896-a07f-ee94f3e8f0fb None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:29:29.483578 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec99a94-2c7d-4896-a07f-ee94f3e8f0fb None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:29:29.483846 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec99a94-2c7d-4896-a07f-ee94f3e8f0fb None admin] PATH_INFO: `/v3/users` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:29:29.484557 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec99a94-2c7d-4896-a07f-ee94f3e8f0fb None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:29:29.484860 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec99a94-2c7d-4896-a07f-ee94f3e8f0fb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:29:29.486305 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec99a94-2c7d-4896-a07f-ee94f3e8f0fb None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:29:29.506969 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 451/902] 10.222.0.104 () {56 vars in 1148 bytes} [Tue Aug 9 16:29:29 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 380 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:29:29.512970 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98be6df-cc16-4ed0-be91-a520e3ece1aa None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:29:29.596080 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:29:29.611553 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98be6df-cc16-4ed0-be91-a520e3ece1aa None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:29:29.644357 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09459ef8-e64b-47c8-90b0-34326d0aa21b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:29:29.644948 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09459ef8-e64b-47c8-90b0-34326d0aa21b None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:29:29.645221 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09459ef8-e64b-47c8-90b0-34326d0aa21b None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:29:29.645487 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09459ef8-e64b-47c8-90b0-34326d0aa21b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:29:29.709489 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09459ef8-e64b-47c8-90b0-34326d0aa21b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:29:29.710937 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09459ef8-e64b-47c8-90b0-34326d0aa21b None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:29:29.796096 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:29:29.812043 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 452/903] 10.222.0.104 () {58 vars in 1287 bytes} [Tue Aug 9 16:29:29 2022] GET /identity/v3/auth/tokens => generated 1873 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 09 16:29:29.817955 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec99a94-2c7d-4896-a07f-ee94f3e8f0fb None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:29:29.886009 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:29:29.925258 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec99a94-2c7d-4896-a07f-ee94f3e8f0fb None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:29:29.962084 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00de592e-55f0-49b1-af69-e46613d465c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:29:29.962975 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00de592e-55f0-49b1-af69-e46613d465c8 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:29:29.963250 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00de592e-55f0-49b1-af69-e46613d465c8 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:29:29.963581 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00de592e-55f0-49b1-af69-e46613d465c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:29:29.974028 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00de592e-55f0-49b1-af69-e46613d465c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:29:29.975768 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00de592e-55f0-49b1-af69-e46613d465c8 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:29:29.990676 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application [None req-00de592e-55f0-49b1-af69-e46613d465c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 16:29:29.990676 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:29:29.990676 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:29:29.990676 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:29:29.990676 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:29:29.990676 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:29:29.990676 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:29:29.990676 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:29:29.990676 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:29:29.990676 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:29:29.990676 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:29:29.990676 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:29:29.990676 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 16:29:29.990676 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 16:29:29.990676 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 16:29:29.990676 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 16:29:29.991758 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:29:29.991758 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:29:29.991758 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:29:29.991758 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:29:29.991758 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:29:29.991758 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:29:29.991758 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:29:29.991758 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application with Lock( Aug 09 16:29:29.991758 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:29:29.991758 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:29:29.991758 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:29:29.991758 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:29:29.991758 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:29:29.991758 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:29:29.991758 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:29:29.991758 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:29:29.991758 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 16:29:29.992851 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 16:29:29.992851 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 16:29:29.992851 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Aug 09 16:29:29.992851 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 452/904] 10.222.0.104 () {56 vars in 1113 bytes} [Tue Aug 9 16:29:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 16:29:29.997485 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09459ef8-e64b-47c8-90b0-34326d0aa21b None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:29:30.092976 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09459ef8-e64b-47c8-90b0-34326d0aa21b None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:29:30.125808 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004a4a27-66b4-4705-94bd-22392fea54dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:29:30.126418 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004a4a27-66b4-4705-94bd-22392fea54dc None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:29:30.126699 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004a4a27-66b4-4705-94bd-22392fea54dc None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:29:30.126972 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004a4a27-66b4-4705-94bd-22392fea54dc None admin] PATH_INFO: `/v3/domains` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:29:30.127600 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004a4a27-66b4-4705-94bd-22392fea54dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=87276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:29:30.128451 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004a4a27-66b4-4705-94bd-22392fea54dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:29:30.129809 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004a4a27-66b4-4705-94bd-22392fea54dc None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:29:30.140672 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 453/905] 10.222.0.104 () {56 vars in 1114 bytes} [Tue Aug 9 16:29:29 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:29:30.146501 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00de592e-55f0-49b1-af69-e46613d465c8 None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:29:30.251613 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00de592e-55f0-49b1-af69-e46613d465c8 None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:29:30.264373 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:29:30.283804 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a7a275-dada-4778-aa86-696916ec5613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:29:30.284930 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a7a275-dada-4778-aa86-696916ec5613 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:29:30.285200 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a7a275-dada-4778-aa86-696916ec5613 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:29:30.285470 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a7a275-dada-4778-aa86-696916ec5613 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:29:30.291787 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a7a275-dada-4778-aa86-696916ec5613 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:29:30.293212 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a7a275-dada-4778-aa86-696916ec5613 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:29:30.304691 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application [None req-c5a7a275-dada-4778-aa86-696916ec5613 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 16:29:30.304691 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:29:30.304691 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:29:30.304691 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:29:30.304691 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:29:30.304691 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:29:30.304691 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:29:30.304691 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:29:30.304691 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:29:30.304691 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:29:30.304691 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:29:30.304691 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:29:30.304691 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 16:29:30.304691 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 16:29:30.304691 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 16:29:30.305653 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 16:29:30.305653 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:29:30.305653 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:29:30.305653 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:29:30.305653 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:29:30.305653 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:29:30.305653 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:29:30.305653 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:29:30.305653 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application with Lock( Aug 09 16:29:30.305653 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:29:30.305653 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:29:30.305653 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:29:30.305653 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:29:30.305653 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:29:30.305653 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:29:30.305653 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:29:30.305653 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:29:30.306603 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 16:29:30.306603 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 16:29:30.306603 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 16:29:30.306603 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 16:29:30.306603 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 16:29:30.306603 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 16:29:30.306603 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 16:29:30.306603 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: ERROR keystone.server.flask.application Aug 09 16:29:30.306603 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 453/906] 10.222.0.104 () {56 vars in 1116 bytes} [Tue Aug 9 16:29:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 16:29:30.313459 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004a4a27-66b4-4705-94bd-22392fea54dc None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:29:30.359076 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:29:30.411771 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004a4a27-66b4-4705-94bd-22392fea54dc None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:29:30.444296 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1177b13-adca-4b3a-a9b6-ccf27f543244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:29:30.444862 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1177b13-adca-4b3a-a9b6-ccf27f543244 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:29:30.445214 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1177b13-adca-4b3a-a9b6-ccf27f543244 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:29:30.445479 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1177b13-adca-4b3a-a9b6-ccf27f543244 None admin] PATH_INFO: `/v3/projects` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:29:30.446176 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1177b13-adca-4b3a-a9b6-ccf27f543244 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:29:30.446474 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1177b13-adca-4b3a-a9b6-ccf27f543244 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:29:30.447882 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1177b13-adca-4b3a-a9b6-ccf27f543244 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:29:30.459248 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 454/907] 10.222.0.104 () {56 vars in 1153 bytes} [Tue Aug 9 16:29:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:29:30.465446 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a7a275-dada-4778-aa86-696916ec5613 None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:29:30.562544 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a7a275-dada-4778-aa86-696916ec5613 None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:29:30.596060 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccd862f-a0fe-4032-9668-ad0566a90d2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:29:30.597435 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccd862f-a0fe-4032-9668-ad0566a90d2b None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:29:30.597726 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccd862f-a0fe-4032-9668-ad0566a90d2b None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:29:30.598019 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccd862f-a0fe-4032-9668-ad0566a90d2b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:29:30.598722 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccd862f-a0fe-4032-9668-ad0566a90d2b None admin] RBAC: Adding query filter params (role.id=c0143e35c1344a39a931bbb6bcd5acdc, scope.project.id=63557f0ff1ce4ae49899b4627bafd94e, user.id=cfd1352d64de487ca4675cbe113e919f) {{(pid=87275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:29:30.599024 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccd862f-a0fe-4032-9668-ad0566a90d2b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:29:30.600424 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccd862f-a0fe-4032-9668-ad0566a90d2b None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:29:30.606087 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 454/908] 10.222.0.104 () {56 vars in 1379 bytes} [Tue Aug 9 16:29:30 2022] GET /identity/v3/role_assignments?user.id=cfd1352d64de487ca4675cbe113e919f&scope.project.id=63557f0ff1ce4ae49899b4627bafd94e&role.id=c0143e35c1344a39a931bbb6bcd5acdc => generated 610 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:29:32.903925 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca86541b-3da8-437d-b3e1-5de6a891371c None None] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:29:32.904473 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca86541b-3da8-437d-b3e1-5de6a891371c None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:29:32.904473 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca86541b-3da8-437d-b3e1-5de6a891371c None None] PATH_INFO: `/` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:29:32.905820 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 455/909] 10.222.0.104 () {54 vars in 932 bytes} [Tue Aug 9 16:29:32 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:29:32.911577 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1622c8-1a43-446b-81ed-742c684afd2d None None] REQUEST_METHOD: `POST` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:29:32.911990 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1622c8-1a43-446b-81ed-742c684afd2d None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:29:32.912127 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1622c8-1a43-446b-81ed-742c684afd2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:29:32.930663 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.auth.core [None req-6a1622c8-1a43-446b-81ed-742c684afd2d None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:29:32.931929 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.fernet_utils [None req-6a1622c8-1a43-446b-81ed-742c684afd2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:29:32.961818 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:29:33.006303 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 455/910] 10.222.0.104 () {58 vars in 1029 bytes} [Tue Aug 9 16:29:32 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 09 16:29:33.033077 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca86541b-3da8-437d-b3e1-5de6a891371c None None] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:29:33.140546 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca86541b-3da8-437d-b3e1-5de6a891371c None None] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:29:33.147620 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:29:33.173732 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e5efea-05af-4bd7-9cbb-50a2f24ab99b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:29:33.174381 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e5efea-05af-4bd7-9cbb-50a2f24ab99b None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:29:33.174657 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e5efea-05af-4bd7-9cbb-50a2f24ab99b None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:29:33.174924 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e5efea-05af-4bd7-9cbb-50a2f24ab99b None admin] PATH_INFO: `/v3/services/placement` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:29:33.175492 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e5efea-05af-4bd7-9cbb-50a2f24ab99b None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:29:33.176911 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e5efea-05af-4bd7-9cbb-50a2f24ab99b None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:29:33.185616 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application [None req-23e5efea-05af-4bd7-9cbb-50a2f24ab99b None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 09 16:29:33.185616 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:29:33.185616 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 16:29:33.185616 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 16:29:33.185616 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 16:29:33.185616 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 16:29:33.185616 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 16:29:33.185616 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 16:29:33.185616 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 09 16:29:33.185616 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Aug 09 16:29:33.185616 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 16:29:33.185616 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Aug 09 16:29:33.185616 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:29:33.185616 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:29:33.185616 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:29:33.185616 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:29:33.185616 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:29:33.186805 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:29:33.186805 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:29:33.186805 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:29:33.186805 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:29:33.186805 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:29:33.186805 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:29:33.186805 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 16:29:33.186805 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 16:29:33.186805 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 16:29:33.186805 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 16:29:33.186805 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:29:33.186805 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:29:33.186805 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:29:33.186805 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:29:33.186805 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:29:33.186805 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:29:33.188112 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:29:33.188112 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application with Lock( Aug 09 16:29:33.188112 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:29:33.188112 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:29:33.188112 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:29:33.188112 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:29:33.188112 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:29:33.188112 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:29:33.188112 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:29:33.188112 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:29:33.188112 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 16:29:33.188112 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 16:29:33.188112 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 09 16:29:33.188112 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Aug 09 16:29:33.188112 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 456/911] 10.222.0.104 () {56 vars in 1122 bytes} [Tue Aug 9 16:29:33 2022] GET /identity/v3/services/placement => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 16:29:33.193282 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1622c8-1a43-446b-81ed-742c684afd2d None None] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:29:33.288843 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1622c8-1a43-446b-81ed-742c684afd2d None None] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:29:33.324712 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250028bb-644c-4608-b61f-d20102c6748f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:29:33.325323 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250028bb-644c-4608-b61f-d20102c6748f None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:29:33.325598 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250028bb-644c-4608-b61f-d20102c6748f None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:29:33.325863 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250028bb-644c-4608-b61f-d20102c6748f None admin] PATH_INFO: `/v3/services` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:29:33.326518 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250028bb-644c-4608-b61f-d20102c6748f None admin] RBAC: Adding query filter params (name=placement) {{(pid=87275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:29:33.326822 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250028bb-644c-4608-b61f-d20102c6748f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:29:33.328249 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250028bb-644c-4608-b61f-d20102c6748f None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:29:33.333972 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 456/912] 10.222.0.104 () {56 vars in 1121 bytes} [Tue Aug 9 16:29:33 2022] GET /identity/v3/services?name=placement => generated 127 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:29:33.340058 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e5efea-05af-4bd7-9cbb-50a2f24ab99b None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:29:33.445513 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e5efea-05af-4bd7-9cbb-50a2f24ab99b None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:29:33.478158 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac17594-9d11-405e-bd68-52359f387b9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:29:33.478753 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac17594-9d11-405e-bd68-52359f387b9e None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:29:33.479031 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac17594-9d11-405e-bd68-52359f387b9e None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:29:33.479301 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac17594-9d11-405e-bd68-52359f387b9e None admin] PATH_INFO: `/v3/services` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:29:33.479920 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac17594-9d11-405e-bd68-52359f387b9e None admin] RBAC: Adding query filter params (type=placement) {{(pid=87276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:29:33.480222 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac17594-9d11-405e-bd68-52359f387b9e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:29:33.481594 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac17594-9d11-405e-bd68-52359f387b9e None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:29:33.485850 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 457/913] 10.222.0.104 () {56 vars in 1121 bytes} [Tue Aug 9 16:29:33 2022] GET /identity/v3/services?type=placement => generated 127 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:29:35.755180 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacc611d-29dc-4cd3-b6d3-fc71597b3773 None None] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:29:35.755742 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacc611d-29dc-4cd3-b6d3-fc71597b3773 None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:29:35.755915 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacc611d-29dc-4cd3-b6d3-fc71597b3773 None None] PATH_INFO: `/` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:29:35.757831 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 457/914] 10.222.0.104 () {54 vars in 932 bytes} [Tue Aug 9 16:29:35 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:29:35.763209 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760344c8-2267-4beb-859c-b233d79ac935 None None] REQUEST_METHOD: `POST` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:29:35.763643 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760344c8-2267-4beb-859c-b233d79ac935 None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:29:35.763899 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760344c8-2267-4beb-859c-b233d79ac935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:29:35.784907 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.auth.core [None req-760344c8-2267-4beb-859c-b233d79ac935 None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:29:35.786149 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.fernet_utils [None req-760344c8-2267-4beb-859c-b233d79ac935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:29:35.814009 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:29:35.855980 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 458/915] 10.222.0.104 () {58 vars in 1029 bytes} [Tue Aug 9 16:29:35 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 09 16:29:35.879814 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacc611d-29dc-4cd3-b6d3-fc71597b3773 None None] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:29:35.916298 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:29:35.988340 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacc611d-29dc-4cd3-b6d3-fc71597b3773 None None] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:29:36.021342 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92b7b82-8999-4510-8109-c5a8a1182ff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:29:36.021873 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92b7b82-8999-4510-8109-c5a8a1182ff1 None admin] REQUEST_METHOD: `POST` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:29:36.022185 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92b7b82-8999-4510-8109-c5a8a1182ff1 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:29:36.022460 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92b7b82-8999-4510-8109-c5a8a1182ff1 None admin] PATH_INFO: `/v3/services` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:29:36.023105 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92b7b82-8999-4510-8109-c5a8a1182ff1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:29:36.024510 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92b7b82-8999-4510-8109-c5a8a1182ff1 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:29:36.042254 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 458/916] 10.222.0.104 () {60 vars in 1146 bytes} [Tue Aug 9 16:29:35 2022] POST /identity/v3/services => generated 247 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 16:29:38.346061 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a494875a-7d5d-4c36-a9f1-2132d8ccd393 None None] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:29:38.346595 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a494875a-7d5d-4c36-a9f1-2132d8ccd393 None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:29:38.346595 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a494875a-7d5d-4c36-a9f1-2132d8ccd393 None None] PATH_INFO: `/` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:29:38.347931 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 459/917] 10.222.0.104 () {54 vars in 932 bytes} [Tue Aug 9 16:29:38 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:29:38.353764 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33342a6c-deb1-454e-a276-edce6fbb4b40 None None] REQUEST_METHOD: `POST` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:29:38.354172 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33342a6c-deb1-454e-a276-edce6fbb4b40 None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:29:38.354371 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33342a6c-deb1-454e-a276-edce6fbb4b40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:29:38.371848 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.auth.core [None req-33342a6c-deb1-454e-a276-edce6fbb4b40 None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:29:38.373028 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.fernet_utils [None req-33342a6c-deb1-454e-a276-edce6fbb4b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:29:38.443949 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 459/918] 10.222.0.104 () {58 vars in 1029 bytes} [Tue Aug 9 16:29:38 2022] POST /identity/v3/auth/tokens => generated 1976 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 16:29:38.467408 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a494875a-7d5d-4c36-a9f1-2132d8ccd393 None None] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:29:38.569540 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a494875a-7d5d-4c36-a9f1-2132d8ccd393 None None] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:29:38.603543 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d165009b-f56a-49a0-bf30-80be7bd41697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:29:38.604094 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d165009b-f56a-49a0-bf30-80be7bd41697 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:29:38.604370 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d165009b-f56a-49a0-bf30-80be7bd41697 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:29:38.604637 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d165009b-f56a-49a0-bf30-80be7bd41697 None admin] PATH_INFO: `/v3/services/placement` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:29:38.605211 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d165009b-f56a-49a0-bf30-80be7bd41697 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:29:38.606618 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d165009b-f56a-49a0-bf30-80be7bd41697 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:29:38.615596 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application [None req-d165009b-f56a-49a0-bf30-80be7bd41697 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 09 16:29:38.615596 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:29:38.615596 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 16:29:38.615596 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 16:29:38.615596 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 16:29:38.615596 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 16:29:38.615596 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 16:29:38.615596 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 16:29:38.615596 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 09 16:29:38.615596 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Aug 09 16:29:38.615596 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 16:29:38.615596 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Aug 09 16:29:38.615596 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:29:38.615596 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:29:38.615596 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:29:38.615596 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:29:38.615596 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:29:38.616762 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:29:38.616762 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:29:38.616762 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:29:38.616762 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:29:38.616762 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:29:38.616762 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:29:38.616762 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 16:29:38.616762 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 16:29:38.616762 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 16:29:38.616762 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 16:29:38.616762 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:29:38.616762 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:29:38.616762 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:29:38.616762 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:29:38.616762 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:29:38.616762 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:29:38.617785 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:29:38.617785 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application with Lock( Aug 09 16:29:38.617785 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:29:38.617785 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:29:38.617785 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:29:38.617785 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:29:38.617785 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:29:38.617785 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:29:38.617785 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:29:38.617785 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:29:38.617785 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 16:29:38.617785 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 16:29:38.617785 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 09 16:29:38.617785 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Aug 09 16:29:38.617785 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 460/919] 10.222.0.104 () {56 vars in 1122 bytes} [Tue Aug 9 16:29:38 2022] GET /identity/v3/services/placement => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 16:29:38.622753 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33342a6c-deb1-454e-a276-edce6fbb4b40 None None] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:29:38.640794 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:29:38.719961 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33342a6c-deb1-454e-a276-edce6fbb4b40 None None] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:29:38.753629 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe4f760-6fea-4cf3-9006-40c608f7f5f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:29:38.754259 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe4f760-6fea-4cf3-9006-40c608f7f5f0 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:29:38.754541 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe4f760-6fea-4cf3-9006-40c608f7f5f0 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:29:38.754811 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe4f760-6fea-4cf3-9006-40c608f7f5f0 None admin] PATH_INFO: `/v3/services` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:29:38.756071 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe4f760-6fea-4cf3-9006-40c608f7f5f0 None admin] RBAC: Adding query filter params (name=placement) {{(pid=87275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:29:38.756376 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe4f760-6fea-4cf3-9006-40c608f7f5f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:29:38.757724 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe4f760-6fea-4cf3-9006-40c608f7f5f0 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:29:38.763829 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 460/920] 10.222.0.104 () {56 vars in 1121 bytes} [Tue Aug 9 16:29:38 2022] GET /identity/v3/services?name=placement => generated 360 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:29:38.769881 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d165009b-f56a-49a0-bf30-80be7bd41697 None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:29:38.798336 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:29:38.879352 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d165009b-f56a-49a0-bf30-80be7bd41697 None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:29:38.912136 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcee394-f362-42ad-89c2-bd99056c0a3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:29:38.912734 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcee394-f362-42ad-89c2-bd99056c0a3d None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:29:38.913008 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcee394-f362-42ad-89c2-bd99056c0a3d None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:29:38.913276 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcee394-f362-42ad-89c2-bd99056c0a3d None admin] PATH_INFO: `/v3/endpoints` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:29:38.914005 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcee394-f362-42ad-89c2-bd99056c0a3d None admin] RBAC: Adding query filter params (interface=public, service_id=a46c98478b5c4c7f846babfa1e89ab37, region_id=RegionOne) {{(pid=87276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:29:38.914307 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcee394-f362-42ad-89c2-bd99056c0a3d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:29:38.915668 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcee394-f362-42ad-89c2-bd99056c0a3d None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:29:38.920466 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 461/921] 10.222.0.104 () {56 vars in 1256 bytes} [Tue Aug 9 16:29:38 2022] GET /identity/v3/endpoints?service_id=a46c98478b5c4c7f846babfa1e89ab37&interface=public®ion_id=RegionOne => generated 195 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:29:38.926341 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe4f760-6fea-4cf3-9006-40c608f7f5f0 None admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:29:39.007337 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:29:39.025791 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe4f760-6fea-4cf3-9006-40c608f7f5f0 None admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:29:39.058811 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4347bb-0727-405c-8399-ae8eb05b67b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:29:39.059406 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4347bb-0727-405c-8399-ae8eb05b67b5 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:29:39.059681 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4347bb-0727-405c-8399-ae8eb05b67b5 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:29:39.059948 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4347bb-0727-405c-8399-ae8eb05b67b5 None admin] PATH_INFO: `/v3/services` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:29:39.060533 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4347bb-0727-405c-8399-ae8eb05b67b5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:29:39.061893 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4347bb-0727-405c-8399-ae8eb05b67b5 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:29:39.068881 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 461/922] 10.222.0.104 () {56 vars in 1092 bytes} [Tue Aug 9 16:29:38 2022] GET /identity/v3/services => generated 1971 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 16:29:41.343245 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945708f5-2237-451e-8541-3cff261fcf29 None None] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:29:41.343781 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945708f5-2237-451e-8541-3cff261fcf29 None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:29:41.343896 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945708f5-2237-451e-8541-3cff261fcf29 None None] PATH_INFO: `/` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:29:41.345133 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 462/923] 10.222.0.104 () {54 vars in 932 bytes} [Tue Aug 9 16:29:41 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:29:41.350250 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f219e75-88ee-46c2-806f-3981aecc3694 None None] REQUEST_METHOD: `POST` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:29:41.350660 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f219e75-88ee-46c2-806f-3981aecc3694 None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:29:41.350796 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f219e75-88ee-46c2-806f-3981aecc3694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:29:41.373515 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.auth.core [None req-0f219e75-88ee-46c2-806f-3981aecc3694 None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:29:41.374753 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.fernet_utils [None req-0f219e75-88ee-46c2-806f-3981aecc3694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:29:41.443142 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 462/924] 10.222.0.104 () {58 vars in 1029 bytes} [Tue Aug 9 16:29:41 2022] POST /identity/v3/auth/tokens => generated 1976 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 16:29:41.468165 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945708f5-2237-451e-8541-3cff261fcf29 None None] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:29:41.559281 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:29:41.569497 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945708f5-2237-451e-8541-3cff261fcf29 None None] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:29:41.602857 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5e1c75-3271-4a86-a72a-eb79702b0cf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:29:41.603411 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5e1c75-3271-4a86-a72a-eb79702b0cf5 None admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:29:41.603690 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5e1c75-3271-4a86-a72a-eb79702b0cf5 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:29:41.604024 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5e1c75-3271-4a86-a72a-eb79702b0cf5 None admin] PATH_INFO: `/v3/services/placement` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:29:41.604540 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5e1c75-3271-4a86-a72a-eb79702b0cf5 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:29:41.605941 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5e1c75-3271-4a86-a72a-eb79702b0cf5 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:29:41.614627 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application [None req-4e5e1c75-3271-4a86-a72a-eb79702b0cf5 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 09 16:29:41.614627 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:29:41.614627 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 16:29:41.614627 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 16:29:41.614627 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 16:29:41.614627 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 16:29:41.614627 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 16:29:41.614627 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 16:29:41.614627 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 09 16:29:41.614627 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Aug 09 16:29:41.614627 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 16:29:41.614627 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Aug 09 16:29:41.614627 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 16:29:41.614627 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 16:29:41.614627 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 16:29:41.614627 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 16:29:41.614627 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 16:29:41.616354 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 16:29:41.616354 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 16:29:41.616354 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 16:29:41.616354 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 16:29:41.616354 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 16:29:41.616354 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 16:29:41.616354 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 16:29:41.616354 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 16:29:41.616354 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 16:29:41.616354 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 16:29:41.616354 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 16:29:41.616354 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 16:29:41.616354 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 16:29:41.616354 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 16:29:41.616354 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 16:29:41.616354 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 16:29:41.617607 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 16:29:41.617607 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application with Lock( Aug 09 16:29:41.617607 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 16:29:41.617607 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self._enter() Aug 09 16:29:41.617607 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 16:29:41.617607 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 16:29:41.617607 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 16:29:41.617607 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application return self.creator() Aug 09 16:29:41.617607 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 16:29:41.617607 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application created_value = creator( Aug 09 16:29:41.617607 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 16:29:41.617607 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 16:29:41.617607 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 09 16:29:41.617607 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: ERROR keystone.server.flask.application Aug 09 16:29:41.617607 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 463/925] 10.222.0.104 () {56 vars in 1122 bytes} [Tue Aug 9 16:29:41 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 16:29:41.622371 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f219e75-88ee-46c2-806f-3981aecc3694 None None] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:29:41.695258 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:29:41.718620 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f219e75-88ee-46c2-806f-3981aecc3694 None None] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:29:41.753252 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb583fee-a5dd-435a-9bff-042ea6bc6041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:29:41.753873 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb583fee-a5dd-435a-9bff-042ea6bc6041 None admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:29:41.754198 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb583fee-a5dd-435a-9bff-042ea6bc6041 None admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:29:41.754491 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb583fee-a5dd-435a-9bff-042ea6bc6041 None admin] PATH_INFO: `/v3/services` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:29:41.755156 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb583fee-a5dd-435a-9bff-042ea6bc6041 None admin] RBAC: Adding query filter params (name=placement) {{(pid=87275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:29:41.755481 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb583fee-a5dd-435a-9bff-042ea6bc6041 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:29:41.756920 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb583fee-a5dd-435a-9bff-042ea6bc6041 None admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:29:41.762175 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 463/926] 10.222.0.104 () {56 vars in 1121 bytes} [Tue Aug 9 16:29:41 2022] GET /identity/v3/services?name=placement => generated 360 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:29:41.768470 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5e1c75-3271-4a86-a72a-eb79702b0cf5 None admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:29:41.867092 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5e1c75-3271-4a86-a72a-eb79702b0cf5 None admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:29:41.899864 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e95ebd-0606-434b-a138-acfbb12b1086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:29:41.900458 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e95ebd-0606-434b-a138-acfbb12b1086 None admin] REQUEST_METHOD: `POST` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:29:41.900742 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e95ebd-0606-434b-a138-acfbb12b1086 None admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:29:41.901011 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e95ebd-0606-434b-a138-acfbb12b1086 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:29:41.901659 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e95ebd-0606-434b-a138-acfbb12b1086 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:29:41.903058 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e95ebd-0606-434b-a138-acfbb12b1086 None admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:29:41.923203 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 464/927] 10.222.0.104 () {60 vars in 1149 bytes} [Tue Aug 9 16:29:41 2022] POST /identity/v3/endpoints => generated 333 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 16:29:51.759701 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=30 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:29:51.919085 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=93,keystone:INSERT=1 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:30:41.836760 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae99af6-380e-4065-8fcc-2082c990aaed None None] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:30:41.837319 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae99af6-380e-4065-8fcc-2082c990aaed None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:30:41.837319 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae99af6-380e-4065-8fcc-2082c990aaed None None] PATH_INFO: `/` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:30:41.842510 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 464/928] 10.222.0.104 () {54 vars in 932 bytes} [Tue Aug 9 16:30:41 2022] GET /identity => generated 271 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:30:41.844308 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff854001-bc10-4ef0-8207-9392f258202d None None] REQUEST_METHOD: `POST` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:30:41.844763 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff854001-bc10-4ef0-8207-9392f258202d None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:30:41.844845 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff854001-bc10-4ef0-8207-9392f258202d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:30:41.898841 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.auth.core [None req-ff854001-bc10-4ef0-8207-9392f258202d None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:30:41.900839 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.fernet_utils [None req-ff854001-bc10-4ef0-8207-9392f258202d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:30:42.013437 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 465/929] 10.222.0.104 () {58 vars in 1029 bytes} [Tue Aug 9 16:30:41 2022] POST /identity/v3/auth/tokens => generated 2807 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 16:30:42.064937 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12473f5f-4df5-4d0a-a7b4-3ffedb762bdd None None] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:30:42.065256 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12473f5f-4df5-4d0a-a7b4-3ffedb762bdd None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:30:42.065549 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12473f5f-4df5-4d0a-a7b4-3ffedb762bdd None None] PATH_INFO: `/` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:30:42.067119 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 465/930] 10.222.0.104 () {54 vars in 970 bytes} [Tue Aug 9 16:30:42 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:30:42.074268 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5b0ffd-6b53-45c1-8294-60bd76cdc03e None None] REQUEST_METHOD: `POST` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:30:42.074831 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5b0ffd-6b53-45c1-8294-60bd76cdc03e None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:30:42.075295 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5b0ffd-6b53-45c1-8294-60bd76cdc03e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:30:42.144129 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.auth.core [None req-6f5b0ffd-6b53-45c1-8294-60bd76cdc03e None None] MFA Rules not processed for user `da49ba8d1a21406eac55503b42fea65b`. Rule list: `[]` (Enabled: `True`). {{(pid=87276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:30:42.145702 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.fernet_utils [None req-6f5b0ffd-6b53-45c1-8294-60bd76cdc03e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:30:42.220169 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12473f5f-4df5-4d0a-a7b4-3ffedb762bdd None None] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:30:42.229242 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 466/931] 10.222.0.104 () {58 vars in 1067 bytes} [Tue Aug 9 16:30:42 2022] POST /identity/v3/auth/tokens => generated 2689 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 16:30:42.233952 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12473f5f-4df5-4d0a-a7b4-3ffedb762bdd None None] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:30:42.238243 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d598865-601f-4669-9b9c-fee1c26e7779 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da49ba8d1a21406eac55503b42fea65b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63557f0ff1ce4ae49899b4627bafd94e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:30:42.239885 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d598865-601f-4669-9b9c-fee1c26e7779 service neutron] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:30:42.240381 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d598865-601f-4669-9b9c-fee1c26e7779 service neutron] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:30:42.240865 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d598865-601f-4669-9b9c-fee1c26e7779 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:30:42.251753 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d598865-601f-4669-9b9c-fee1c26e7779 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:30:42.253579 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d598865-601f-4669-9b9c-fee1c26e7779 service neutron] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:30:42.274992 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 466/932] 10.222.0.104 () {60 vars in 1370 bytes} [Tue Aug 9 16:30:42 2022] GET /identity/v3/auth/tokens => generated 2807 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 16:30:44.895905 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dfaf6d-0012-41af-b712-ef6216b4fa01 None None] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:30:44.896904 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dfaf6d-0012-41af-b712-ef6216b4fa01 None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:30:44.897184 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dfaf6d-0012-41af-b712-ef6216b4fa01 None None] PATH_INFO: `/` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:30:44.898562 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 467/933] 10.222.0.104 () {54 vars in 932 bytes} [Tue Aug 9 16:30:44 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:30:44.904148 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942a7289-1b47-4779-a046-fa8e830e10c5 None None] REQUEST_METHOD: `POST` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:30:44.904577 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942a7289-1b47-4779-a046-fa8e830e10c5 None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:30:44.904683 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942a7289-1b47-4779-a046-fa8e830e10c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:30:44.927201 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.auth.core [None req-942a7289-1b47-4779-a046-fa8e830e10c5 None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:30:44.928382 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.fernet_utils [None req-942a7289-1b47-4779-a046-fa8e830e10c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:30:44.936093 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 467/934] 10.222.0.104 () {58 vars in 1029 bytes} [Tue Aug 9 16:30:44 2022] POST /identity/v3/auth/tokens => generated 2807 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 16:30:44.977086 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dfaf6d-0012-41af-b712-ef6216b4fa01 None None] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:30:44.987813 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dfaf6d-0012-41af-b712-ef6216b4fa01 None None] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:30:44.991378 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5c6523-543e-4f93-87bb-b85813f24b5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da49ba8d1a21406eac55503b42fea65b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63557f0ff1ce4ae49899b4627bafd94e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:30:44.992040 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5c6523-543e-4f93-87bb-b85813f24b5b service neutron] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:30:44.992388 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5c6523-543e-4f93-87bb-b85813f24b5b service neutron] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:30:44.992730 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5c6523-543e-4f93-87bb-b85813f24b5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:30:45.002358 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5c6523-543e-4f93-87bb-b85813f24b5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:30:45.004420 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5c6523-543e-4f93-87bb-b85813f24b5b service neutron] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:30:45.014966 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 468/935] 10.222.0.104 () {60 vars in 1370 bytes} [Tue Aug 9 16:30:44 2022] GET /identity/v3/auth/tokens => generated 2807 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 16:30:47.686991 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5b1aeb-7970-4123-bf28-d5210cd035a7 None None] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:30:47.687492 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5b1aeb-7970-4123-bf28-d5210cd035a7 None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:30:47.687492 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5b1aeb-7970-4123-bf28-d5210cd035a7 None None] PATH_INFO: `/` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:30:47.688830 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 468/936] 10.222.0.104 () {54 vars in 932 bytes} [Tue Aug 9 16:30:47 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:30:47.694778 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d35802-d262-4e9a-8052-2f007570e463 None None] REQUEST_METHOD: `POST` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:30:47.695180 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d35802-d262-4e9a-8052-2f007570e463 None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:30:47.695437 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d35802-d262-4e9a-8052-2f007570e463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:30:47.731267 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.auth.core [None req-d2d35802-d262-4e9a-8052-2f007570e463 None None] MFA Rules not processed for user `90e486c670fa4bac812f14eb300edcae`. Rule list: `[]` (Enabled: `True`). {{(pid=87276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:30:47.732454 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.fernet_utils [None req-d2d35802-d262-4e9a-8052-2f007570e463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:30:47.781651 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:30:47.811390 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 469/937] 10.222.0.104 () {58 vars in 1029 bytes} [Tue Aug 9 16:30:47 2022] POST /identity/v3/auth/tokens => generated 2811 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 16:30:47.856913 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5b1aeb-7970-4123-bf28-d5210cd035a7 None None] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:30:47.867324 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5b1aeb-7970-4123-bf28-d5210cd035a7 None None] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:30:47.870768 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69b577d-f4cd-4591-923b-6ae4fc20f29c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da49ba8d1a21406eac55503b42fea65b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63557f0ff1ce4ae49899b4627bafd94e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:30:47.871355 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69b577d-f4cd-4591-923b-6ae4fc20f29c service neutron] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:30:47.871630 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69b577d-f4cd-4591-923b-6ae4fc20f29c service neutron] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:30:47.871899 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69b577d-f4cd-4591-923b-6ae4fc20f29c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:30:47.880974 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69b577d-f4cd-4591-923b-6ae4fc20f29c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:30:47.882742 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69b577d-f4cd-4591-923b-6ae4fc20f29c service neutron] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:30:47.891737 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 469/938] 10.222.0.104 () {60 vars in 1370 bytes} [Tue Aug 9 16:30:47 2022] GET /identity/v3/auth/tokens => generated 2811 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 16:30:50.758836 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f7d20f-e28b-4f76-b3eb-0e7c9cc05e4c None None] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:30:50.759433 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f7d20f-e28b-4f76-b3eb-0e7c9cc05e4c None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:30:50.759433 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f7d20f-e28b-4f76-b3eb-0e7c9cc05e4c None None] PATH_INFO: `/` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:30:50.760689 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 470/939] 10.222.0.104 () {54 vars in 932 bytes} [Tue Aug 9 16:30:50 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:30:50.765765 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81bd88c-4655-4bf5-8d17-89acb3b3cf1a None None] REQUEST_METHOD: `POST` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:30:50.766226 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81bd88c-4655-4bf5-8d17-89acb3b3cf1a None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:30:50.766323 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81bd88c-4655-4bf5-8d17-89acb3b3cf1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:30:50.785338 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.auth.core [None req-d81bd88c-4655-4bf5-8d17-89acb3b3cf1a None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:30:50.786660 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.fernet_utils [None req-d81bd88c-4655-4bf5-8d17-89acb3b3cf1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:30:50.851351 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 470/940] 10.222.0.104 () {58 vars in 1029 bytes} [Tue Aug 9 16:30:50 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 16:30:50.890885 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f7d20f-e28b-4f76-b3eb-0e7c9cc05e4c None None] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:30:50.901951 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f7d20f-e28b-4f76-b3eb-0e7c9cc05e4c None None] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:30:50.905367 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbc4504-1428-4c3f-a3bc-8b4fc03101f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da49ba8d1a21406eac55503b42fea65b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63557f0ff1ce4ae49899b4627bafd94e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:30:50.905990 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbc4504-1428-4c3f-a3bc-8b4fc03101f7 service neutron] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:30:50.906270 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbc4504-1428-4c3f-a3bc-8b4fc03101f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:30:50.906542 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbc4504-1428-4c3f-a3bc-8b4fc03101f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:30:50.915043 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbc4504-1428-4c3f-a3bc-8b4fc03101f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:30:50.916471 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbc4504-1428-4c3f-a3bc-8b4fc03101f7 service neutron] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:30:50.925894 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 471/941] 10.222.0.104 () {60 vars in 1370 bytes} [Tue Aug 9 16:30:50 2022] GET /identity/v3/auth/tokens => generated 2806 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 16:30:53.927152 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02813b6-1a59-49fc-b63a-7b1e4502c092 None None] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:30:53.927679 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02813b6-1a59-49fc-b63a-7b1e4502c092 None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:30:53.927679 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02813b6-1a59-49fc-b63a-7b1e4502c092 None None] PATH_INFO: `/` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:30:53.929030 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 471/942] 10.222.0.104 () {54 vars in 932 bytes} [Tue Aug 9 16:30:53 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:30:53.934799 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb70a5b-9b65-4514-98d6-34cc9753b5b1 None None] REQUEST_METHOD: `POST` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:30:53.935233 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb70a5b-9b65-4514-98d6-34cc9753b5b1 None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:30:53.935334 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb70a5b-9b65-4514-98d6-34cc9753b5b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:30:53.955686 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.auth.core [None req-8fb70a5b-9b65-4514-98d6-34cc9753b5b1 None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:30:53.956858 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.fernet_utils [None req-8fb70a5b-9b65-4514-98d6-34cc9753b5b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:30:53.964816 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 472/943] 10.222.0.104 () {58 vars in 1029 bytes} [Tue Aug 9 16:30:53 2022] POST /identity/v3/auth/tokens => generated 2807 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 16:30:54.002269 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02813b6-1a59-49fc-b63a-7b1e4502c092 None None] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:30:54.013393 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02813b6-1a59-49fc-b63a-7b1e4502c092 None None] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:30:54.016925 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9952b8c-95e3-47c7-bb17-ebf572912f1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da49ba8d1a21406eac55503b42fea65b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63557f0ff1ce4ae49899b4627bafd94e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:30:54.017524 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9952b8c-95e3-47c7-bb17-ebf572912f1e service neutron] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:30:54.017797 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9952b8c-95e3-47c7-bb17-ebf572912f1e service neutron] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:30:54.018092 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9952b8c-95e3-47c7-bb17-ebf572912f1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:30:54.026816 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9952b8c-95e3-47c7-bb17-ebf572912f1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:30:54.028232 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9952b8c-95e3-47c7-bb17-ebf572912f1e service neutron] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:30:54.038160 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 472/944] 10.222.0.104 () {60 vars in 1370 bytes} [Tue Aug 9 16:30:54 2022] GET /identity/v3/auth/tokens => generated 2807 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 16:30:56.390052 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e654976-c236-4d0a-8ac3-3101baf2c62a None None] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:30:56.390578 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e654976-c236-4d0a-8ac3-3101baf2c62a None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:30:56.390578 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e654976-c236-4d0a-8ac3-3101baf2c62a None None] PATH_INFO: `/` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:30:56.391835 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 473/945] 10.222.0.104 () {54 vars in 932 bytes} [Tue Aug 9 16:30:56 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:30:56.397428 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9477f2ac-9942-44fc-870c-fc5a22ffa287 None None] REQUEST_METHOD: `POST` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:30:56.397856 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9477f2ac-9942-44fc-870c-fc5a22ffa287 None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:30:56.398008 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9477f2ac-9942-44fc-870c-fc5a22ffa287 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:30:56.416994 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.auth.core [None req-9477f2ac-9942-44fc-870c-fc5a22ffa287 None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:30:56.418232 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.fernet_utils [None req-9477f2ac-9942-44fc-870c-fc5a22ffa287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:30:56.425973 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 473/946] 10.222.0.104 () {58 vars in 1029 bytes} [Tue Aug 9 16:30:56 2022] POST /identity/v3/auth/tokens => generated 2807 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 16:30:56.463217 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e654976-c236-4d0a-8ac3-3101baf2c62a None None] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:30:56.473877 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e654976-c236-4d0a-8ac3-3101baf2c62a None None] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:30:56.477618 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274ec48d-258e-4e2d-9aea-bc9105fc8a32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da49ba8d1a21406eac55503b42fea65b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63557f0ff1ce4ae49899b4627bafd94e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:30:56.478245 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274ec48d-258e-4e2d-9aea-bc9105fc8a32 service neutron] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:30:56.478531 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274ec48d-258e-4e2d-9aea-bc9105fc8a32 service neutron] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:30:56.478804 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274ec48d-258e-4e2d-9aea-bc9105fc8a32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:30:56.490963 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274ec48d-258e-4e2d-9aea-bc9105fc8a32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:30:56.492396 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274ec48d-258e-4e2d-9aea-bc9105fc8a32 service neutron] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:30:56.502077 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 474/947] 10.222.0.104 () {60 vars in 1370 bytes} [Tue Aug 9 16:30:56 2022] GET /identity/v3/auth/tokens => generated 2807 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 16:30:58.858156 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de7f21a-6275-4075-ac7d-014d628bf21f None None] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:30:58.858733 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de7f21a-6275-4075-ac7d-014d628bf21f None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:30:58.858733 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de7f21a-6275-4075-ac7d-014d628bf21f None None] PATH_INFO: `/` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:30:58.860100 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 474/948] 10.222.0.104 () {54 vars in 932 bytes} [Tue Aug 9 16:30:58 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:30:58.865374 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f20b1c7-02b8-4e2b-b378-1462461b9863 None None] REQUEST_METHOD: `POST` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:30:58.865847 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f20b1c7-02b8-4e2b-b378-1462461b9863 None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:30:58.866091 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f20b1c7-02b8-4e2b-b378-1462461b9863 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:30:58.885050 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.auth.core [None req-7f20b1c7-02b8-4e2b-b378-1462461b9863 None None] MFA Rules not processed for user `90e486c670fa4bac812f14eb300edcae`. Rule list: `[]` (Enabled: `True`). {{(pid=87276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:30:58.886325 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.fernet_utils [None req-7f20b1c7-02b8-4e2b-b378-1462461b9863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:30:58.894229 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 475/949] 10.222.0.104 () {58 vars in 1029 bytes} [Tue Aug 9 16:30:58 2022] POST /identity/v3/auth/tokens => generated 2811 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 16:30:58.948859 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4724a6-bb15-4928-bab0-cf5b0140ddbb None None] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:30:58.949240 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4724a6-bb15-4928-bab0-cf5b0140ddbb None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:30:58.949574 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4724a6-bb15-4928-bab0-cf5b0140ddbb None None] PATH_INFO: `/` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:30:58.951032 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 475/950] 10.222.0.104 () {54 vars in 970 bytes} [Tue Aug 9 16:30:58 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:30:58.957132 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2aca96-9206-411a-a976-e382b661bf41 None None] REQUEST_METHOD: `POST` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:30:58.957407 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2aca96-9206-411a-a976-e382b661bf41 None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:30:58.957673 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2aca96-9206-411a-a976-e382b661bf41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:30:58.977584 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.auth.core [None req-3e2aca96-9206-411a-a976-e382b661bf41 None None] MFA Rules not processed for user `da49ba8d1a21406eac55503b42fea65b`. Rule list: `[]` (Enabled: `True`). {{(pid=87276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:30:58.978920 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.fernet_utils [None req-3e2aca96-9206-411a-a976-e382b661bf41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:30:58.985234 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 476/951] 10.222.0.104 () {58 vars in 1067 bytes} [Tue Aug 9 16:30:58 2022] POST /identity/v3/auth/tokens => generated 2689 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 16:30:58.994730 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4724a6-bb15-4928-bab0-cf5b0140ddbb None None] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:30:59.005132 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4724a6-bb15-4928-bab0-cf5b0140ddbb None None] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:30:59.008949 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903eb6bb-5318-48aa-acd2-825b30a9a00d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da49ba8d1a21406eac55503b42fea65b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63557f0ff1ce4ae49899b4627bafd94e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:30:59.009543 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903eb6bb-5318-48aa-acd2-825b30a9a00d service neutron] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:30:59.009816 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903eb6bb-5318-48aa-acd2-825b30a9a00d service neutron] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:30:59.010117 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903eb6bb-5318-48aa-acd2-825b30a9a00d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:30:59.018936 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903eb6bb-5318-48aa-acd2-825b30a9a00d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:30:59.020286 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903eb6bb-5318-48aa-acd2-825b30a9a00d service neutron] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:30:59.029350 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 476/952] 10.222.0.104 () {60 vars in 1370 bytes} [Tue Aug 9 16:30:58 2022] GET /identity/v3/auth/tokens => generated 2811 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 16:31:01.928552 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc8e7e2-1e5e-41d8-ab45-08bf10619bef None None] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:31:01.929071 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc8e7e2-1e5e-41d8-ab45-08bf10619bef None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:31:01.929071 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc8e7e2-1e5e-41d8-ab45-08bf10619bef None None] PATH_INFO: `/` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:31:01.930447 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 477/953] 10.222.0.104 () {54 vars in 932 bytes} [Tue Aug 9 16:31:01 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:31:01.935692 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c84edaa-6c8d-4726-8a95-c292058e60b3 None None] REQUEST_METHOD: `POST` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:31:01.936141 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c84edaa-6c8d-4726-8a95-c292058e60b3 None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:31:01.936215 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c84edaa-6c8d-4726-8a95-c292058e60b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:31:01.956979 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.auth.core [None req-9c84edaa-6c8d-4726-8a95-c292058e60b3 None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:31:01.958250 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.fernet_utils [None req-9c84edaa-6c8d-4726-8a95-c292058e60b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:31:01.966682 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 477/954] 10.222.0.104 () {58 vars in 1029 bytes} [Tue Aug 9 16:31:01 2022] POST /identity/v3/auth/tokens => generated 2807 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 16:31:02.003761 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc8e7e2-1e5e-41d8-ab45-08bf10619bef None None] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:31:02.015241 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc8e7e2-1e5e-41d8-ab45-08bf10619bef None None] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:31:02.018587 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00869c6f-543a-49a5-b126-58713b6b29ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da49ba8d1a21406eac55503b42fea65b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63557f0ff1ce4ae49899b4627bafd94e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:31:02.019178 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00869c6f-543a-49a5-b126-58713b6b29ec service neutron] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:31:02.019456 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00869c6f-543a-49a5-b126-58713b6b29ec service neutron] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:31:02.019723 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00869c6f-543a-49a5-b126-58713b6b29ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:31:02.029403 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00869c6f-543a-49a5-b126-58713b6b29ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:31:02.030856 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00869c6f-543a-49a5-b126-58713b6b29ec service neutron] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:31:02.041160 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 478/955] 10.222.0.104 () {60 vars in 1370 bytes} [Tue Aug 9 16:31:02 2022] GET /identity/v3/auth/tokens => generated 2807 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 16:31:04.406148 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235a08af-dd5d-4453-a839-25a31bcdc838 None None] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:31:04.406650 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235a08af-dd5d-4453-a839-25a31bcdc838 None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:31:04.406650 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235a08af-dd5d-4453-a839-25a31bcdc838 None None] PATH_INFO: `/` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:31:04.407909 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 478/956] 10.222.0.104 () {54 vars in 932 bytes} [Tue Aug 9 16:31:04 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:31:04.413616 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6c58a0-2294-463f-9e42-191d4cbba231 None None] REQUEST_METHOD: `POST` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:31:04.414062 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6c58a0-2294-463f-9e42-191d4cbba231 None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:31:04.414198 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6c58a0-2294-463f-9e42-191d4cbba231 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:31:04.432600 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.auth.core [None req-6e6c58a0-2294-463f-9e42-191d4cbba231 None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:31:04.433777 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.fernet_utils [None req-6e6c58a0-2294-463f-9e42-191d4cbba231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:31:04.441342 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 479/957] 10.222.0.104 () {58 vars in 1029 bytes} [Tue Aug 9 16:31:04 2022] POST /identity/v3/auth/tokens => generated 2807 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 16:31:04.482780 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235a08af-dd5d-4453-a839-25a31bcdc838 None None] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:31:04.493295 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235a08af-dd5d-4453-a839-25a31bcdc838 None None] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:31:04.496683 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c03e3a-118c-44dd-beb9-3c805875366f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da49ba8d1a21406eac55503b42fea65b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63557f0ff1ce4ae49899b4627bafd94e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:31:04.497263 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c03e3a-118c-44dd-beb9-3c805875366f service neutron] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:31:04.497532 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c03e3a-118c-44dd-beb9-3c805875366f service neutron] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:31:04.497796 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c03e3a-118c-44dd-beb9-3c805875366f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:31:04.506470 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c03e3a-118c-44dd-beb9-3c805875366f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:31:04.507879 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c03e3a-118c-44dd-beb9-3c805875366f service neutron] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:31:04.516972 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 479/958] 10.222.0.104 () {60 vars in 1370 bytes} [Tue Aug 9 16:31:04 2022] GET /identity/v3/auth/tokens => generated 2807 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 16:31:07.159158 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2898990-3fc4-4f3d-a299-43d7ae2ae896 None None] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:31:07.159661 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2898990-3fc4-4f3d-a299-43d7ae2ae896 None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:31:07.159661 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2898990-3fc4-4f3d-a299-43d7ae2ae896 None None] PATH_INFO: `/` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:31:07.160940 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 480/959] 10.222.0.104 () {54 vars in 932 bytes} [Tue Aug 9 16:31:07 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:31:07.166119 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ab42e2-1647-40fd-adf3-6b1b2ef34e6c None None] REQUEST_METHOD: `POST` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:31:07.166566 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ab42e2-1647-40fd-adf3-6b1b2ef34e6c None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:31:07.166662 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ab42e2-1647-40fd-adf3-6b1b2ef34e6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:31:07.185095 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.auth.core [None req-c9ab42e2-1647-40fd-adf3-6b1b2ef34e6c None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:31:07.186327 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.fernet_utils [None req-c9ab42e2-1647-40fd-adf3-6b1b2ef34e6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:31:07.194483 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 480/960] 10.222.0.104 () {58 vars in 1029 bytes} [Tue Aug 9 16:31:07 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 16:31:07.233029 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2898990-3fc4-4f3d-a299-43d7ae2ae896 None None] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:31:07.243395 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2898990-3fc4-4f3d-a299-43d7ae2ae896 None None] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:31:07.246859 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfa4de6-ddfb-4dc5-ba13-0c95f16d7df5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da49ba8d1a21406eac55503b42fea65b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63557f0ff1ce4ae49899b4627bafd94e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:31:07.247447 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfa4de6-ddfb-4dc5-ba13-0c95f16d7df5 service neutron] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:31:07.247723 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfa4de6-ddfb-4dc5-ba13-0c95f16d7df5 service neutron] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:31:07.247989 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfa4de6-ddfb-4dc5-ba13-0c95f16d7df5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:31:07.256971 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfa4de6-ddfb-4dc5-ba13-0c95f16d7df5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:31:07.258436 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfa4de6-ddfb-4dc5-ba13-0c95f16d7df5 service neutron] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:31:07.267471 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 481/961] 10.222.0.104 () {60 vars in 1370 bytes} [Tue Aug 9 16:31:07 2022] GET /identity/v3/auth/tokens => generated 2806 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 16:31:11.476466 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963daba9-0026-4e4c-8148-e62c0e289ada None None] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:31:11.477022 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963daba9-0026-4e4c-8148-e62c0e289ada None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:31:11.477022 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963daba9-0026-4e4c-8148-e62c0e289ada None None] PATH_INFO: `/` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:31:11.478385 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 481/962] 10.222.0.104 () {54 vars in 932 bytes} [Tue Aug 9 16:31:11 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:31:11.483525 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db03833-5a92-466c-a442-403672303caa None None] REQUEST_METHOD: `POST` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:31:11.483926 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db03833-5a92-466c-a442-403672303caa None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:31:11.484100 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db03833-5a92-466c-a442-403672303caa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:31:11.504355 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.auth.core [None req-6db03833-5a92-466c-a442-403672303caa None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:31:11.505604 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.fernet_utils [None req-6db03833-5a92-466c-a442-403672303caa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:31:11.513174 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 482/963] 10.222.0.104 () {58 vars in 1029 bytes} [Tue Aug 9 16:31:11 2022] POST /identity/v3/auth/tokens => generated 2807 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 16:31:11.553305 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963daba9-0026-4e4c-8148-e62c0e289ada None None] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:31:11.563972 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963daba9-0026-4e4c-8148-e62c0e289ada None None] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:31:11.567467 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62866845-e4c9-471e-9c09-66cf93e4b221 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da49ba8d1a21406eac55503b42fea65b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63557f0ff1ce4ae49899b4627bafd94e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:31:11.568044 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62866845-e4c9-471e-9c09-66cf93e4b221 service neutron] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:31:11.568315 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62866845-e4c9-471e-9c09-66cf93e4b221 service neutron] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:31:11.568581 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62866845-e4c9-471e-9c09-66cf93e4b221 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:31:11.578263 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62866845-e4c9-471e-9c09-66cf93e4b221 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:31:11.579726 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62866845-e4c9-471e-9c09-66cf93e4b221 service neutron] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:31:11.589394 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 482/964] 10.222.0.104 () {60 vars in 1370 bytes} [Tue Aug 9 16:31:11 2022] GET /identity/v3/auth/tokens => generated 2807 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 16:31:14.536377 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56021654-ee23-4415-a2ef-8b84b97d6f4d None None] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:31:14.536943 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56021654-ee23-4415-a2ef-8b84b97d6f4d None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:31:14.536943 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56021654-ee23-4415-a2ef-8b84b97d6f4d None None] PATH_INFO: `/` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:31:14.538822 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 483/965] 10.222.0.104 () {54 vars in 932 bytes} [Tue Aug 9 16:31:14 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:31:14.544105 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463f9af8-4f0e-49ad-9e71-e450e92d6e5c None None] REQUEST_METHOD: `POST` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:31:14.544553 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463f9af8-4f0e-49ad-9e71-e450e92d6e5c None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:31:14.544725 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463f9af8-4f0e-49ad-9e71-e450e92d6e5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:31:14.552048 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=80 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:31:14.565028 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.auth.core [None req-463f9af8-4f0e-49ad-9e71-e450e92d6e5c None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:31:14.566253 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.fernet_utils [None req-463f9af8-4f0e-49ad-9e71-e450e92d6e5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:31:14.574456 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 483/966] 10.222.0.104 () {58 vars in 1029 bytes} [Tue Aug 9 16:31:14 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 16:31:14.613150 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56021654-ee23-4415-a2ef-8b84b97d6f4d None None] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:31:14.623755 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56021654-ee23-4415-a2ef-8b84b97d6f4d None None] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:31:14.627225 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2442e7-aa7c-4b54-8cd6-964a72adf684 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da49ba8d1a21406eac55503b42fea65b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63557f0ff1ce4ae49899b4627bafd94e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:31:14.627821 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2442e7-aa7c-4b54-8cd6-964a72adf684 service neutron] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:31:14.628097 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2442e7-aa7c-4b54-8cd6-964a72adf684 service neutron] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:31:14.628368 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2442e7-aa7c-4b54-8cd6-964a72adf684 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:31:14.637698 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2442e7-aa7c-4b54-8cd6-964a72adf684 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:31:14.639161 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2442e7-aa7c-4b54-8cd6-964a72adf684 service neutron] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:31:14.649467 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 484/967] 10.222.0.104 () {60 vars in 1370 bytes} [Tue Aug 9 16:31:14 2022] GET /identity/v3/auth/tokens => generated 2806 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 16:31:18.865170 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15b7290-0ebd-4827-9bca-178744445343 None None] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:31:18.865729 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15b7290-0ebd-4827-9bca-178744445343 None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:31:18.865729 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15b7290-0ebd-4827-9bca-178744445343 None None] PATH_INFO: `/` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:31:18.867086 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 484/968] 10.222.0.104 () {54 vars in 932 bytes} [Tue Aug 9 16:31:18 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:31:18.872210 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a09cd1c-532a-4ddc-9214-e50b8b6826ca None None] REQUEST_METHOD: `POST` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:31:18.872648 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a09cd1c-532a-4ddc-9214-e50b8b6826ca None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:31:18.872750 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a09cd1c-532a-4ddc-9214-e50b8b6826ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:31:18.880019 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=57 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:31:18.893683 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.auth.core [None req-5a09cd1c-532a-4ddc-9214-e50b8b6826ca None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:31:18.894908 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.fernet_utils [None req-5a09cd1c-532a-4ddc-9214-e50b8b6826ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:31:18.903098 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 485/969] 10.222.0.104 () {58 vars in 1029 bytes} [Tue Aug 9 16:31:18 2022] POST /identity/v3/auth/tokens => generated 2807 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 16:31:18.942037 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15b7290-0ebd-4827-9bca-178744445343 None None] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:31:18.952910 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15b7290-0ebd-4827-9bca-178744445343 None None] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:31:18.956320 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed20dbbd-714c-4888-872c-7a9045a1359e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da49ba8d1a21406eac55503b42fea65b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63557f0ff1ce4ae49899b4627bafd94e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:31:18.956903 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed20dbbd-714c-4888-872c-7a9045a1359e service neutron] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:31:18.957176 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed20dbbd-714c-4888-872c-7a9045a1359e service neutron] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:31:18.957441 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed20dbbd-714c-4888-872c-7a9045a1359e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:31:18.966584 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed20dbbd-714c-4888-872c-7a9045a1359e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:31:18.967993 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed20dbbd-714c-4888-872c-7a9045a1359e service neutron] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:31:18.977639 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 485/970] 10.222.0.104 () {60 vars in 1370 bytes} [Tue Aug 9 16:31:18 2022] GET /identity/v3/auth/tokens => generated 2807 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 16:31:24.688554 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000b3a52-3f89-44d6-8ffd-3f6b6e12a9aa None None] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:31:24.689659 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000b3a52-3f89-44d6-8ffd-3f6b6e12a9aa None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:31:24.689659 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000b3a52-3f89-44d6-8ffd-3f6b6e12a9aa None None] PATH_INFO: `/` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:31:24.693580 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 486/971] 10.222.0.104 () {54 vars in 926 bytes} [Tue Aug 9 16:31:24 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:31:24.707428 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56addd50-4b35-4bdc-a351-ed5b2f27074f None None] REQUEST_METHOD: `POST` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:31:24.711203 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56addd50-4b35-4bdc-a351-ed5b2f27074f None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:31:24.711658 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56addd50-4b35-4bdc-a351-ed5b2f27074f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:31:24.768284 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.auth.core [None req-56addd50-4b35-4bdc-a351-ed5b2f27074f None None] MFA Rules not processed for user `cfd1352d64de487ca4675cbe113e919f`. Rule list: `[]` (Enabled: `True`). {{(pid=87275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:31:24.768284 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.fernet_utils [None req-56addd50-4b35-4bdc-a351-ed5b2f27074f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:31:24.852314 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 486/972] 10.222.0.104 () {58 vars in 1023 bytes} [Tue Aug 9 16:31:24 2022] POST /identity/v3/auth/tokens => generated 2876 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 16:31:28.888760 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=2 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:31:29.337013 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb915d3-528d-42d0-b448-7ca3ae3ed5c7 None None] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:31:29.337529 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb915d3-528d-42d0-b448-7ca3ae3ed5c7 None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:31:29.337973 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb915d3-528d-42d0-b448-7ca3ae3ed5c7 None None] PATH_INFO: `/` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:31:29.339820 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 487/973] 10.222.0.104 () {54 vars in 926 bytes} [Tue Aug 9 16:31:29 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:31:29.344955 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97a1a77-6709-4f5d-a0bd-4eba0c7c2d5c None None] REQUEST_METHOD: `POST` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:31:29.345443 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97a1a77-6709-4f5d-a0bd-4eba0c7c2d5c None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:31:29.345526 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97a1a77-6709-4f5d-a0bd-4eba0c7c2d5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:31:29.365629 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.auth.core [None req-e97a1a77-6709-4f5d-a0bd-4eba0c7c2d5c None None] MFA Rules not processed for user `cfd1352d64de487ca4675cbe113e919f`. Rule list: `[]` (Enabled: `True`). {{(pid=87275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:31:29.367009 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.fernet_utils [None req-e97a1a77-6709-4f5d-a0bd-4eba0c7c2d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:31:29.375940 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 487/974] 10.222.0.104 () {58 vars in 1023 bytes} [Tue Aug 9 16:31:29 2022] POST /identity/v3/auth/tokens => generated 2876 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 16:31:30.949018 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5fc695-d224-46b3-8dd7-52371bf280fa None None] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:31:30.949534 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5fc695-d224-46b3-8dd7-52371bf280fa None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:31:30.949640 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5fc695-d224-46b3-8dd7-52371bf280fa None None] PATH_INFO: `/` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:31:30.950917 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 488/975] 10.222.0.104 () {54 vars in 926 bytes} [Tue Aug 9 16:31:30 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:31:30.956173 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf52caf6-1147-45b8-a028-4cb1faa77cc6 None None] REQUEST_METHOD: `POST` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:31:30.956569 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf52caf6-1147-45b8-a028-4cb1faa77cc6 None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:31:30.956864 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf52caf6-1147-45b8-a028-4cb1faa77cc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:31:30.978265 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.auth.core [None req-cf52caf6-1147-45b8-a028-4cb1faa77cc6 None None] MFA Rules not processed for user `cfd1352d64de487ca4675cbe113e919f`. Rule list: `[]` (Enabled: `True`). {{(pid=87275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:31:30.979426 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.fernet_utils [None req-cf52caf6-1147-45b8-a028-4cb1faa77cc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:31:30.987650 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 488/976] 10.222.0.104 () {58 vars in 1023 bytes} [Tue Aug 9 16:31:30 2022] POST /identity/v3/auth/tokens => generated 2876 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 16:31:34.988288 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed98eda1-db19-41ae-8017-93f931cf9ce0 None None] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:31:34.988830 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed98eda1-db19-41ae-8017-93f931cf9ce0 None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:31:34.988830 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed98eda1-db19-41ae-8017-93f931cf9ce0 None None] PATH_INFO: `/` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:31:34.990147 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 489/977] 10.222.0.104 () {54 vars in 932 bytes} [Tue Aug 9 16:31:34 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:31:34.995778 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3a1285-452f-4808-90a9-4d849d348b26 None None] REQUEST_METHOD: `POST` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:31:34.996211 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3a1285-452f-4808-90a9-4d849d348b26 None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:31:34.996316 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3a1285-452f-4808-90a9-4d849d348b26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:31:35.016566 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.auth.core [None req-3c3a1285-452f-4808-90a9-4d849d348b26 None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:31:35.017748 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.fernet_utils [None req-3c3a1285-452f-4808-90a9-4d849d348b26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:31:35.026224 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 489/978] 10.222.0.104 () {58 vars in 1029 bytes} [Tue Aug 9 16:31:34 2022] POST /identity/v3/auth/tokens => generated 2807 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 16:31:35.084868 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ee9f20-a3bd-4c31-b0ad-fc866f772088 None None] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:31:35.085611 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ee9f20-a3bd-4c31-b0ad-fc866f772088 None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:31:35.087680 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ee9f20-a3bd-4c31-b0ad-fc866f772088 None None] PATH_INFO: `/` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:31:35.091058 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 490/979] 10.222.0.104 () {54 vars in 967 bytes} [Tue Aug 9 16:31:35 2022] GET /identity => generated 271 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 09 16:31:35.107647 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5270e6f3-e595-4bca-9140-c4ff8779ae35 None None] REQUEST_METHOD: `POST` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:31:35.108109 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5270e6f3-e595-4bca-9140-c4ff8779ae35 None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:31:35.108536 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5270e6f3-e595-4bca-9140-c4ff8779ae35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:31:35.148119 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.auth.core [None req-5270e6f3-e595-4bca-9140-c4ff8779ae35 None None] MFA Rules not processed for user `b4c33c3fc318484d9cdfae778d23f06a`. Rule list: `[]` (Enabled: `True`). {{(pid=87275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:31:35.149853 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.fernet_utils [None req-5270e6f3-e595-4bca-9140-c4ff8779ae35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:31:35.222115 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 490/980] 10.222.0.104 () {58 vars in 1064 bytes} [Tue Aug 9 16:31:35 2022] POST /identity/v3/auth/tokens => generated 2871 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 16:31:35.230928 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ee9f20-a3bd-4c31-b0ad-fc866f772088 None None] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:31:35.244530 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ee9f20-a3bd-4c31-b0ad-fc866f772088 None None] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:31:35.249429 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22e92eb-d4db-4357-a163-1959e5fa956d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4c33c3fc318484d9cdfae778d23f06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63557f0ff1ce4ae49899b4627bafd94e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:31:35.250046 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22e92eb-d4db-4357-a163-1959e5fa956d service nova] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:31:35.250330 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22e92eb-d4db-4357-a163-1959e5fa956d service nova] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:31:35.250603 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22e92eb-d4db-4357-a163-1959e5fa956d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:31:35.259779 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22e92eb-d4db-4357-a163-1959e5fa956d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:31:35.261407 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22e92eb-d4db-4357-a163-1959e5fa956d service nova] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:31:35.271055 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 491/981] 10.222.0.104 () {60 vars in 1370 bytes} [Tue Aug 9 16:31:35 2022] GET /identity/v3/auth/tokens => generated 2807 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 16:31:37.794364 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9348a0-4e9d-470d-bdc8-234617bcf76c None None] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:31:37.794879 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9348a0-4e9d-470d-bdc8-234617bcf76c None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:31:37.794879 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9348a0-4e9d-470d-bdc8-234617bcf76c None None] PATH_INFO: `/` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:31:37.796507 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 491/982] 10.222.0.104 () {54 vars in 932 bytes} [Tue Aug 9 16:31:37 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:31:37.801721 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9efd6e-5c31-448b-8030-8d93885190ad None None] REQUEST_METHOD: `POST` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:31:37.802173 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9efd6e-5c31-448b-8030-8d93885190ad None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:31:37.802344 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9efd6e-5c31-448b-8030-8d93885190ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:31:37.823433 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.auth.core [None req-8c9efd6e-5c31-448b-8030-8d93885190ad None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:31:37.824629 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.fernet_utils [None req-8c9efd6e-5c31-448b-8030-8d93885190ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:31:37.833321 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 492/983] 10.222.0.104 () {58 vars in 1029 bytes} [Tue Aug 9 16:31:37 2022] POST /identity/v3/auth/tokens => generated 2807 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 16:31:37.881026 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9348a0-4e9d-470d-bdc8-234617bcf76c None None] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:31:37.895019 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9348a0-4e9d-470d-bdc8-234617bcf76c None None] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:31:37.900201 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d1c91c-afcd-4bc8-bd82-ada017c960a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4c33c3fc318484d9cdfae778d23f06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63557f0ff1ce4ae49899b4627bafd94e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:31:37.900863 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d1c91c-afcd-4bc8-bd82-ada017c960a0 service nova] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:31:37.901232 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d1c91c-afcd-4bc8-bd82-ada017c960a0 service nova] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:31:37.901573 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d1c91c-afcd-4bc8-bd82-ada017c960a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:31:37.910444 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d1c91c-afcd-4bc8-bd82-ada017c960a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:31:37.912084 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d1c91c-afcd-4bc8-bd82-ada017c960a0 service nova] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:31:37.916493 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=100 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:31:37.923950 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 492/984] 10.222.0.104 () {60 vars in 1370 bytes} [Tue Aug 9 16:31:37 2022] GET /identity/v3/auth/tokens => generated 2807 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 16:31:40.566640 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42893f6d-adf2-4577-91f2-4b216140d0ab None None] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:31:40.567460 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42893f6d-adf2-4577-91f2-4b216140d0ab None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:31:40.567918 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42893f6d-adf2-4577-91f2-4b216140d0ab None None] PATH_INFO: `/` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:31:40.569713 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 493/985] 10.222.0.104 () {54 vars in 932 bytes} [Tue Aug 9 16:31:40 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:31:40.578163 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e6b868-16c3-42b6-b9f6-2f3d6884f2f7 None None] REQUEST_METHOD: `POST` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:31:40.578163 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e6b868-16c3-42b6-b9f6-2f3d6884f2f7 None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:31:40.578163 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e6b868-16c3-42b6-b9f6-2f3d6884f2f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:31:40.608505 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.auth.core [None req-d8e6b868-16c3-42b6-b9f6-2f3d6884f2f7 None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:31:40.609882 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.fernet_utils [None req-d8e6b868-16c3-42b6-b9f6-2f3d6884f2f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:31:40.618028 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 493/986] 10.222.0.104 () {58 vars in 1029 bytes} [Tue Aug 9 16:31:40 2022] POST /identity/v3/auth/tokens => generated 2807 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 16:31:40.663857 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a525a9-a3ab-4c70-94c6-e37bf78d2c13 None None] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:31:40.664135 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a525a9-a3ab-4c70-94c6-e37bf78d2c13 None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:31:40.664402 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a525a9-a3ab-4c70-94c6-e37bf78d2c13 None None] PATH_INFO: `/` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:31:40.666481 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 494/987] 10.222.0.104 () {54 vars in 967 bytes} [Tue Aug 9 16:31:40 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:31:40.671610 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c5f8e9-8145-4c85-bd4b-f775c8577045 None None] REQUEST_METHOD: `POST` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:31:40.671881 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c5f8e9-8145-4c85-bd4b-f775c8577045 None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:31:40.672144 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c5f8e9-8145-4c85-bd4b-f775c8577045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:31:40.691075 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.auth.core [None req-13c5f8e9-8145-4c85-bd4b-f775c8577045 None None] MFA Rules not processed for user `b4c33c3fc318484d9cdfae778d23f06a`. Rule list: `[]` (Enabled: `True`). {{(pid=87275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:31:40.692238 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.fernet_utils [None req-13c5f8e9-8145-4c85-bd4b-f775c8577045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:31:40.700751 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 494/988] 10.222.0.104 () {58 vars in 1064 bytes} [Tue Aug 9 16:31:40 2022] POST /identity/v3/auth/tokens => generated 2871 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 16:31:40.708729 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a525a9-a3ab-4c70-94c6-e37bf78d2c13 None None] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:31:40.723178 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a525a9-a3ab-4c70-94c6-e37bf78d2c13 None None] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:31:40.728725 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187fa4bc-9dc3-46b9-8f01-2471a462a6fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4c33c3fc318484d9cdfae778d23f06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63557f0ff1ce4ae49899b4627bafd94e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:31:40.729319 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187fa4bc-9dc3-46b9-8f01-2471a462a6fd service nova] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:31:40.729598 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187fa4bc-9dc3-46b9-8f01-2471a462a6fd service nova] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:31:40.729871 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187fa4bc-9dc3-46b9-8f01-2471a462a6fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:31:40.737860 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187fa4bc-9dc3-46b9-8f01-2471a462a6fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:31:40.739456 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187fa4bc-9dc3-46b9-8f01-2471a462a6fd service nova] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:31:40.748789 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 495/989] 10.222.0.104 () {60 vars in 1370 bytes} [Tue Aug 9 16:31:40 2022] GET /identity/v3/auth/tokens => generated 2807 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 16:31:43.189936 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632b7b9c-946c-4d8c-aae2-788f01d07e9b None None] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:31:43.190889 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632b7b9c-946c-4d8c-aae2-788f01d07e9b None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:31:43.191331 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632b7b9c-946c-4d8c-aae2-788f01d07e9b None None] PATH_INFO: `/` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:31:43.196632 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 495/990] 10.222.0.104 () {54 vars in 932 bytes} [Tue Aug 9 16:31:43 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:31:43.198585 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99676fe-1589-424f-85da-8863744e0a39 None None] REQUEST_METHOD: `POST` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:31:43.199310 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99676fe-1589-424f-85da-8863744e0a39 None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:31:43.199757 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99676fe-1589-424f-85da-8863744e0a39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:31:43.220181 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.auth.core [None req-e99676fe-1589-424f-85da-8863744e0a39 None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:31:43.221605 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.fernet_utils [None req-e99676fe-1589-424f-85da-8863744e0a39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:31:43.238272 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 496/991] 10.222.0.104 () {58 vars in 1029 bytes} [Tue Aug 9 16:31:43 2022] POST /identity/v3/auth/tokens => generated 2807 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 16:31:43.277284 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632b7b9c-946c-4d8c-aae2-788f01d07e9b None None] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:31:43.291907 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632b7b9c-946c-4d8c-aae2-788f01d07e9b None None] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:31:43.297207 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4d7037-faa0-4818-ad57-f56a8c724580 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4c33c3fc318484d9cdfae778d23f06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63557f0ff1ce4ae49899b4627bafd94e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:31:43.298014 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4d7037-faa0-4818-ad57-f56a8c724580 service nova] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:31:43.298458 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4d7037-faa0-4818-ad57-f56a8c724580 service nova] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:31:43.298874 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4d7037-faa0-4818-ad57-f56a8c724580 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:31:43.308555 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4d7037-faa0-4818-ad57-f56a8c724580 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:31:43.310348 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4d7037-faa0-4818-ad57-f56a8c724580 service nova] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:31:43.331707 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 496/992] 10.222.0.104 () {60 vars in 1370 bytes} [Tue Aug 9 16:31:43 2022] GET /identity/v3/auth/tokens => generated 2807 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 16:31:45.083326 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd2f2eb-a2e8-401e-8939-2b9092414fb8 None None] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:31:45.083748 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd2f2eb-a2e8-401e-8939-2b9092414fb8 None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:31:45.083962 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd2f2eb-a2e8-401e-8939-2b9092414fb8 None None] PATH_INFO: `/` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:31:45.091240 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b821ebe6-a9e4-4987-acdb-0fad626285fc None None] REQUEST_METHOD: `POST` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:31:45.091627 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b821ebe6-a9e4-4987-acdb-0fad626285fc None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:31:45.092097 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b821ebe6-a9e4-4987-acdb-0fad626285fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:31:45.095069 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 497/993] 10.222.0.104 () {54 vars in 932 bytes} [Tue Aug 9 16:31:45 2022] GET /identity => generated 271 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:31:45.150896 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.auth.core [None req-b821ebe6-a9e4-4987-acdb-0fad626285fc None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:31:45.155291 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.fernet_utils [None req-b821ebe6-a9e4-4987-acdb-0fad626285fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:31:45.165511 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 497/994] 10.222.0.104 () {58 vars in 1029 bytes} [Tue Aug 9 16:31:45 2022] POST /identity/v3/auth/tokens => generated 2807 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 16:31:45.499619 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a58b7ea-aa8c-4e3d-b866-581ea007d932 None None] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:31:45.500171 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a58b7ea-aa8c-4e3d-b866-581ea007d932 None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:31:45.500586 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a58b7ea-aa8c-4e3d-b866-581ea007d932 None None] PATH_INFO: `/` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:31:45.502107 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 498/995] 10.222.0.104 () {54 vars in 969 bytes} [Tue Aug 9 16:31:45 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:31:45.507522 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afabaa0d-36ed-4f96-90c5-14a20fa943b4 None None] REQUEST_METHOD: `POST` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:31:45.508052 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afabaa0d-36ed-4f96-90c5-14a20fa943b4 None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:31:45.508471 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afabaa0d-36ed-4f96-90c5-14a20fa943b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:31:45.550769 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.auth.core [None req-afabaa0d-36ed-4f96-90c5-14a20fa943b4 None None] MFA Rules not processed for user `e914013dfd8b448e8cdbd6b8399cfd0c`. Rule list: `[]` (Enabled: `True`). {{(pid=87275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:31:45.552196 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.fernet_utils [None req-afabaa0d-36ed-4f96-90c5-14a20fa943b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:31:45.612690 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 498/996] 10.222.0.104 () {58 vars in 1066 bytes} [Tue Aug 9 16:31:45 2022] POST /identity/v3/auth/tokens => generated 2688 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 16:31:45.621014 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a58b7ea-aa8c-4e3d-b866-581ea007d932 None None] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:31:45.631800 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a58b7ea-aa8c-4e3d-b866-581ea007d932 None None] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:31:45.635290 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63ec3e7-433a-44bc-b518-39ba08db508c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e914013dfd8b448e8cdbd6b8399cfd0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63557f0ff1ce4ae49899b4627bafd94e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:31:45.635884 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63ec3e7-433a-44bc-b518-39ba08db508c service cinder] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:31:45.636183 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63ec3e7-433a-44bc-b518-39ba08db508c service cinder] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:31:45.636454 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63ec3e7-433a-44bc-b518-39ba08db508c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:31:45.645736 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63ec3e7-433a-44bc-b518-39ba08db508c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:31:45.647315 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63ec3e7-433a-44bc-b518-39ba08db508c service cinder] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:31:45.657928 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 499/997] 10.222.0.104 () {60 vars in 1370 bytes} [Tue Aug 9 16:31:45 2022] GET /identity/v3/auth/tokens => generated 2807 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 16:31:45.893497 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf22e8a-e01b-42ba-94d0-1c62d7fbf301 None None] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:31:45.893844 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf22e8a-e01b-42ba-94d0-1c62d7fbf301 None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:31:45.894149 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf22e8a-e01b-42ba-94d0-1c62d7fbf301 None None] PATH_INFO: `/` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:31:45.895628 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 499/998] 10.222.0.104 () {54 vars in 932 bytes} [Tue Aug 9 16:31:45 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:31:45.901097 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f045eb17-7251-4895-8bb4-c17898389686 None None] REQUEST_METHOD: `POST` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:31:45.901485 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f045eb17-7251-4895-8bb4-c17898389686 None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:31:45.901884 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f045eb17-7251-4895-8bb4-c17898389686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:31:45.921846 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.auth.core [None req-f045eb17-7251-4895-8bb4-c17898389686 None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:31:45.923061 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.fernet_utils [None req-f045eb17-7251-4895-8bb4-c17898389686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:31:45.933343 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 500/999] 10.222.0.104 () {58 vars in 1029 bytes} [Tue Aug 9 16:31:45 2022] POST /identity/v3/auth/tokens => generated 2807 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 16:31:45.976810 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf22e8a-e01b-42ba-94d0-1c62d7fbf301 None None] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:31:45.991402 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf22e8a-e01b-42ba-94d0-1c62d7fbf301 None None] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:31:45.996991 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1fa51d-a235-4fa5-8d6b-0a750d7ba2ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4c33c3fc318484d9cdfae778d23f06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63557f0ff1ce4ae49899b4627bafd94e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:31:45.997829 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1fa51d-a235-4fa5-8d6b-0a750d7ba2ea service nova] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:31:45.998371 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1fa51d-a235-4fa5-8d6b-0a750d7ba2ea service nova] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:31:45.998857 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1fa51d-a235-4fa5-8d6b-0a750d7ba2ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:31:46.007775 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1fa51d-a235-4fa5-8d6b-0a750d7ba2ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:31:46.009620 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1fa51d-a235-4fa5-8d6b-0a750d7ba2ea service nova] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:31:46.019964 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 500/1000] 10.222.0.104 () {60 vars in 1370 bytes} [Tue Aug 9 16:31:45 2022] GET /identity/v3/auth/tokens => generated 2807 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 16:31:48.399198 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d06131-db65-40bf-a9dd-f5f02f2d5394 None None] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:31:48.399643 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d06131-db65-40bf-a9dd-f5f02f2d5394 None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:31:48.399756 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d06131-db65-40bf-a9dd-f5f02f2d5394 None None] PATH_INFO: `/` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:31:48.401086 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 501/1001] 10.222.0.104 () {54 vars in 932 bytes} [Tue Aug 9 16:31:48 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:31:48.408726 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a2738a-a6cf-4479-b2e5-f38f5f28a499 None None] REQUEST_METHOD: `POST` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:31:48.409210 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a2738a-a6cf-4479-b2e5-f38f5f28a499 None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:31:48.409312 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a2738a-a6cf-4479-b2e5-f38f5f28a499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:31:48.429441 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.auth.core [None req-54a2738a-a6cf-4479-b2e5-f38f5f28a499 None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:31:48.430680 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.fernet_utils [None req-54a2738a-a6cf-4479-b2e5-f38f5f28a499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:31:48.440175 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 501/1002] 10.222.0.104 () {58 vars in 1029 bytes} [Tue Aug 9 16:31:48 2022] POST /identity/v3/auth/tokens => generated 2807 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 16:31:48.486041 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d06131-db65-40bf-a9dd-f5f02f2d5394 None None] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:31:48.501080 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d06131-db65-40bf-a9dd-f5f02f2d5394 None None] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:31:48.511476 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f80e12-77c2-40c4-8389-ae3fc73217b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4c33c3fc318484d9cdfae778d23f06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63557f0ff1ce4ae49899b4627bafd94e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:31:48.512692 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f80e12-77c2-40c4-8389-ae3fc73217b4 service nova] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:31:48.513220 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f80e12-77c2-40c4-8389-ae3fc73217b4 service nova] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:31:48.513690 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f80e12-77c2-40c4-8389-ae3fc73217b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:31:48.525303 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f80e12-77c2-40c4-8389-ae3fc73217b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:31:48.530127 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f80e12-77c2-40c4-8389-ae3fc73217b4 service nova] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:31:48.542319 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 502/1003] 10.222.0.104 () {60 vars in 1370 bytes} [Tue Aug 9 16:31:48 2022] GET /identity/v3/auth/tokens => generated 2807 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 16:31:50.929843 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f60913-8fc9-4afd-b2cd-736b8eeaabb4 None None] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:31:50.930848 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f60913-8fc9-4afd-b2cd-736b8eeaabb4 None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:31:50.931142 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f60913-8fc9-4afd-b2cd-736b8eeaabb4 None None] PATH_INFO: `/` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:31:50.932549 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 502/1004] 10.222.0.104 () {54 vars in 932 bytes} [Tue Aug 9 16:31:50 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:31:50.937745 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d25afae-3748-4231-b512-b82a8dc54d32 None None] REQUEST_METHOD: `POST` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:31:50.938219 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d25afae-3748-4231-b512-b82a8dc54d32 None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:31:50.938338 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d25afae-3748-4231-b512-b82a8dc54d32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:31:50.958050 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.auth.core [None req-7d25afae-3748-4231-b512-b82a8dc54d32 None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:31:50.959254 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.fernet_utils [None req-7d25afae-3748-4231-b512-b82a8dc54d32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:31:50.969940 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 503/1005] 10.222.0.104 () {58 vars in 1029 bytes} [Tue Aug 9 16:31:50 2022] POST /identity/v3/auth/tokens => generated 2807 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 16:31:51.009602 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f60913-8fc9-4afd-b2cd-736b8eeaabb4 None None] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:31:51.023522 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f60913-8fc9-4afd-b2cd-736b8eeaabb4 None None] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:31:51.029671 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4320ccb5-a383-4744-922c-a7114b00ebc3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4c33c3fc318484d9cdfae778d23f06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63557f0ff1ce4ae49899b4627bafd94e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:31:51.030286 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4320ccb5-a383-4744-922c-a7114b00ebc3 service nova] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:31:51.030579 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4320ccb5-a383-4744-922c-a7114b00ebc3 service nova] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:31:51.030839 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4320ccb5-a383-4744-922c-a7114b00ebc3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:31:51.039405 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4320ccb5-a383-4744-922c-a7114b00ebc3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:31:51.041567 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4320ccb5-a383-4744-922c-a7114b00ebc3 service nova] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:31:51.055064 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 503/1006] 10.222.0.104 () {60 vars in 1370 bytes} [Tue Aug 9 16:31:51 2022] GET /identity/v3/auth/tokens => generated 2807 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 16:31:53.425297 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb6b058-6a61-4e0a-a35e-90eb153aec05 None None] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:31:53.425855 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb6b058-6a61-4e0a-a35e-90eb153aec05 None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:31:53.425855 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb6b058-6a61-4e0a-a35e-90eb153aec05 None None] PATH_INFO: `/` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:31:53.427194 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 504/1007] 10.222.0.104 () {54 vars in 932 bytes} [Tue Aug 9 16:31:53 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:31:53.433296 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86157e2-adf0-4cd2-ba0d-7d9b0a22bf7f None None] REQUEST_METHOD: `POST` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:31:53.434156 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86157e2-adf0-4cd2-ba0d-7d9b0a22bf7f None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:31:53.434641 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86157e2-adf0-4cd2-ba0d-7d9b0a22bf7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:31:53.453599 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.auth.core [None req-f86157e2-adf0-4cd2-ba0d-7d9b0a22bf7f None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:31:53.455372 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.fernet_utils [None req-f86157e2-adf0-4cd2-ba0d-7d9b0a22bf7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:31:53.464439 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 504/1008] 10.222.0.104 () {58 vars in 1029 bytes} [Tue Aug 9 16:31:53 2022] POST /identity/v3/auth/tokens => generated 2807 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 16:31:53.509419 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb6b058-6a61-4e0a-a35e-90eb153aec05 None None] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:31:53.524243 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb6b058-6a61-4e0a-a35e-90eb153aec05 None None] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:31:53.529998 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d99e4f-19fd-4537-8de8-e5305f248222 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4c33c3fc318484d9cdfae778d23f06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63557f0ff1ce4ae49899b4627bafd94e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:31:53.530677 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d99e4f-19fd-4537-8de8-e5305f248222 service nova] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:31:53.531024 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d99e4f-19fd-4537-8de8-e5305f248222 service nova] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:31:53.531382 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d99e4f-19fd-4537-8de8-e5305f248222 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:31:53.539817 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d99e4f-19fd-4537-8de8-e5305f248222 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:31:53.541518 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d99e4f-19fd-4537-8de8-e5305f248222 service nova] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:31:53.551560 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 505/1009] 10.222.0.104 () {60 vars in 1370 bytes} [Tue Aug 9 16:31:53 2022] GET /identity/v3/auth/tokens => generated 2807 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 16:31:56.643728 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2f2cfb-f421-4681-8b4f-a7ba5e6598c8 None None] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:31:56.653647 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2f2cfb-f421-4681-8b4f-a7ba5e6598c8 None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:31:56.653647 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2f2cfb-f421-4681-8b4f-a7ba5e6598c8 None None] PATH_INFO: `/` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:31:56.653647 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 505/1010] 10.222.0.104 () {54 vars in 932 bytes} [Tue Aug 9 16:31:56 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:31:56.653978 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86799344-d4db-4d1d-b754-00965d9fed19 None None] REQUEST_METHOD: `POST` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:31:56.653978 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86799344-d4db-4d1d-b754-00965d9fed19 None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:31:56.653978 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86799344-d4db-4d1d-b754-00965d9fed19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:31:56.672688 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.auth.core [None req-86799344-d4db-4d1d-b754-00965d9fed19 None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:31:56.673909 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.fernet_utils [None req-86799344-d4db-4d1d-b754-00965d9fed19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:31:56.685493 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 506/1011] 10.222.0.104 () {58 vars in 1029 bytes} [Tue Aug 9 16:31:56 2022] POST /identity/v3/auth/tokens => generated 2807 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 16:31:56.734171 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2f2cfb-f421-4681-8b4f-a7ba5e6598c8 None None] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:31:56.748660 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2f2cfb-f421-4681-8b4f-a7ba5e6598c8 None None] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:31:56.753972 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259f6b38-1f33-4a5e-8aac-217d86256bbc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4c33c3fc318484d9cdfae778d23f06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63557f0ff1ce4ae49899b4627bafd94e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:31:56.754564 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259f6b38-1f33-4a5e-8aac-217d86256bbc service nova] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:31:56.754844 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259f6b38-1f33-4a5e-8aac-217d86256bbc service nova] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:31:56.755128 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259f6b38-1f33-4a5e-8aac-217d86256bbc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:31:56.764169 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259f6b38-1f33-4a5e-8aac-217d86256bbc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:31:56.765859 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259f6b38-1f33-4a5e-8aac-217d86256bbc service nova] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:31:56.775891 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 506/1012] 10.222.0.104 () {60 vars in 1370 bytes} [Tue Aug 9 16:31:56 2022] GET /identity/v3/auth/tokens => generated 2807 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 16:32:00.032654 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ec3c28-d360-4c11-a528-3bc07e854f67 None None] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:32:00.033321 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ec3c28-d360-4c11-a528-3bc07e854f67 None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:32:00.033321 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ec3c28-d360-4c11-a528-3bc07e854f67 None None] PATH_INFO: `/` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:32:00.034579 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 507/1013] 10.222.0.104 () {54 vars in 932 bytes} [Tue Aug 9 16:32:00 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:32:00.039867 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dc6f13-2d0d-465c-bcfc-27a5df52615a None None] REQUEST_METHOD: `POST` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:32:00.040350 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dc6f13-2d0d-465c-bcfc-27a5df52615a None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:32:00.040452 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dc6f13-2d0d-465c-bcfc-27a5df52615a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:32:00.059603 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.auth.core [None req-64dc6f13-2d0d-465c-bcfc-27a5df52615a None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:32:00.060794 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.fernet_utils [None req-64dc6f13-2d0d-465c-bcfc-27a5df52615a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:32:00.068534 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 507/1014] 10.222.0.104 () {58 vars in 1029 bytes} [Tue Aug 9 16:32:00 2022] POST /identity/v3/auth/tokens => generated 2807 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 16:32:00.114613 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ec3c28-d360-4c11-a528-3bc07e854f67 None None] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:32:00.122285 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=46 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:32:00.130104 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ec3c28-d360-4c11-a528-3bc07e854f67 None None] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:32:00.135032 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adb4ca8-2d5e-467c-95a8-8d35558a008a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4c33c3fc318484d9cdfae778d23f06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63557f0ff1ce4ae49899b4627bafd94e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:32:00.135639 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adb4ca8-2d5e-467c-95a8-8d35558a008a service nova] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:32:00.135914 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adb4ca8-2d5e-467c-95a8-8d35558a008a service nova] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:32:00.136208 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adb4ca8-2d5e-467c-95a8-8d35558a008a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:32:00.144714 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adb4ca8-2d5e-467c-95a8-8d35558a008a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:32:00.146333 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adb4ca8-2d5e-467c-95a8-8d35558a008a service nova] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:32:00.156713 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 508/1015] 10.222.0.104 () {60 vars in 1370 bytes} [Tue Aug 9 16:32:00 2022] GET /identity/v3/auth/tokens => generated 2807 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 16:32:01.721645 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4d1f25-ffa9-4bd9-850b-bc2ee354b658 None None] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:32:01.722269 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4d1f25-ffa9-4bd9-850b-bc2ee354b658 None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:32:01.722269 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4d1f25-ffa9-4bd9-850b-bc2ee354b658 None None] PATH_INFO: `/` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:32:01.723585 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 508/1016] 10.222.0.104 () {54 vars in 932 bytes} [Tue Aug 9 16:32:01 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:32:01.728892 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d7766e-b9ad-40f7-a3f6-dbed98406c38 None None] REQUEST_METHOD: `POST` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:32:01.729342 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d7766e-b9ad-40f7-a3f6-dbed98406c38 None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:32:01.729529 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d7766e-b9ad-40f7-a3f6-dbed98406c38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:32:01.750200 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.auth.core [None req-26d7766e-b9ad-40f7-a3f6-dbed98406c38 None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:32:01.751400 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.fernet_utils [None req-26d7766e-b9ad-40f7-a3f6-dbed98406c38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:32:01.759119 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 509/1017] 10.222.0.104 () {58 vars in 1029 bytes} [Tue Aug 9 16:32:01 2022] POST /identity/v3/auth/tokens => generated 2807 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 16:32:01.817992 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb34ecbd-c694-45de-8a83-89bdcb337877 None None] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:32:01.818277 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb34ecbd-c694-45de-8a83-89bdcb337877 None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:32:01.818555 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb34ecbd-c694-45de-8a83-89bdcb337877 None None] PATH_INFO: `/` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:32:01.820002 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 509/1018] 10.222.0.104 () {54 vars in 972 bytes} [Tue Aug 9 16:32:01 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:32:01.825718 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1695620-1216-41e5-b072-6ab4a588488d None None] REQUEST_METHOD: `POST` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:32:01.826039 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1695620-1216-41e5-b072-6ab4a588488d None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:32:01.826314 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1695620-1216-41e5-b072-6ab4a588488d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:32:01.864271 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.auth.core [None req-a1695620-1216-41e5-b072-6ab4a588488d None None] MFA Rules not processed for user `717261252a9a44de8a71c10fda7082b0`. Rule list: `[]` (Enabled: `True`). {{(pid=87276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:32:01.865456 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.fernet_utils [None req-a1695620-1216-41e5-b072-6ab4a588488d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:32:01.927264 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 510/1019] 10.222.0.104 () {58 vars in 1069 bytes} [Tue Aug 9 16:32:01 2022] POST /identity/v3/auth/tokens => generated 2688 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 16:32:01.934698 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb34ecbd-c694-45de-8a83-89bdcb337877 None None] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:32:01.945299 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb34ecbd-c694-45de-8a83-89bdcb337877 None None] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:32:01.949294 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f220c858-d04e-4117-af4a-a0b5771ae710 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '717261252a9a44de8a71c10fda7082b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63557f0ff1ce4ae49899b4627bafd94e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:32:01.949876 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f220c858-d04e-4117-af4a-a0b5771ae710 service glance] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:32:01.950181 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f220c858-d04e-4117-af4a-a0b5771ae710 service glance] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:32:01.950456 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f220c858-d04e-4117-af4a-a0b5771ae710 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:32:01.959613 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f220c858-d04e-4117-af4a-a0b5771ae710 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:32:01.961028 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f220c858-d04e-4117-af4a-a0b5771ae710 service glance] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:32:01.970912 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 510/1020] 10.222.0.104 () {60 vars in 1370 bytes} [Tue Aug 9 16:32:01 2022] GET /identity/v3/auth/tokens => generated 2807 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 16:32:02.485482 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46971d7-94c6-466b-9a26-e6d5956c2edb None None] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:32:02.485759 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46971d7-94c6-466b-9a26-e6d5956c2edb None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:32:02.486075 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46971d7-94c6-466b-9a26-e6d5956c2edb None None] PATH_INFO: `/` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:32:02.487388 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 511/1021] 10.222.0.104 () {54 vars in 932 bytes} [Tue Aug 9 16:32:02 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:32:02.492708 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640080e7-ab66-451f-84fe-02e134095ef0 None None] REQUEST_METHOD: `POST` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:32:02.492988 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640080e7-ab66-451f-84fe-02e134095ef0 None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:32:02.493264 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640080e7-ab66-451f-84fe-02e134095ef0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:32:02.516695 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.auth.core [None req-640080e7-ab66-451f-84fe-02e134095ef0 None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:32:02.517952 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.fernet_utils [None req-640080e7-ab66-451f-84fe-02e134095ef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:32:02.526182 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 511/1022] 10.222.0.104 () {58 vars in 1029 bytes} [Tue Aug 9 16:32:02 2022] POST /identity/v3/auth/tokens => generated 2807 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 16:32:02.578320 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46971d7-94c6-466b-9a26-e6d5956c2edb None None] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:32:02.593929 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46971d7-94c6-466b-9a26-e6d5956c2edb None None] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:32:02.601996 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b58be7-a8a6-4c53-a864-bae3b111953e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4c33c3fc318484d9cdfae778d23f06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63557f0ff1ce4ae49899b4627bafd94e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:32:02.602613 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b58be7-a8a6-4c53-a864-bae3b111953e service nova] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:32:02.602899 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b58be7-a8a6-4c53-a864-bae3b111953e service nova] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:32:02.603172 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b58be7-a8a6-4c53-a864-bae3b111953e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:32:02.614589 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b58be7-a8a6-4c53-a864-bae3b111953e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:32:02.616207 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b58be7-a8a6-4c53-a864-bae3b111953e service nova] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:32:02.629545 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 512/1023] 10.222.0.104 () {60 vars in 1370 bytes} [Tue Aug 9 16:32:02 2022] GET /identity/v3/auth/tokens => generated 2807 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 16:32:05.018422 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5536ab63-3a85-4436-b40b-b7bd37c57f20 None None] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:32:05.019066 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5536ab63-3a85-4436-b40b-b7bd37c57f20 None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:32:05.019066 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5536ab63-3a85-4436-b40b-b7bd37c57f20 None None] PATH_INFO: `/` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:32:05.020203 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 512/1024] 10.222.0.104 () {54 vars in 932 bytes} [Tue Aug 9 16:32:05 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:32:05.025668 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f9d3c6-9eda-4217-900b-03c621c52480 None None] REQUEST_METHOD: `POST` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:32:05.026624 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f9d3c6-9eda-4217-900b-03c621c52480 None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:32:05.026931 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f9d3c6-9eda-4217-900b-03c621c52480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:32:05.047012 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.auth.core [None req-f5f9d3c6-9eda-4217-900b-03c621c52480 None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:32:05.048238 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.fernet_utils [None req-f5f9d3c6-9eda-4217-900b-03c621c52480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:32:05.056072 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 513/1025] 10.222.0.104 () {58 vars in 1029 bytes} [Tue Aug 9 16:32:05 2022] POST /identity/v3/auth/tokens => generated 2807 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 16:32:05.106312 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5536ab63-3a85-4436-b40b-b7bd37c57f20 None None] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:32:05.120723 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5536ab63-3a85-4436-b40b-b7bd37c57f20 None None] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:32:05.125645 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23efd7bc-f490-4e89-81c9-1259383e41ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4c33c3fc318484d9cdfae778d23f06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63557f0ff1ce4ae49899b4627bafd94e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:32:05.126282 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23efd7bc-f490-4e89-81c9-1259383e41ec service nova] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:32:05.126561 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23efd7bc-f490-4e89-81c9-1259383e41ec service nova] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:32:05.126831 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23efd7bc-f490-4e89-81c9-1259383e41ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:32:05.135533 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23efd7bc-f490-4e89-81c9-1259383e41ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:32:05.137108 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23efd7bc-f490-4e89-81c9-1259383e41ec service nova] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:32:05.148973 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 513/1026] 10.222.0.104 () {60 vars in 1370 bytes} [Tue Aug 9 16:32:05 2022] GET /identity/v3/auth/tokens => generated 2807 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 16:32:15.041125 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=50 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:32:15.143306 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=91 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:32:17.496594 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee40cd72-18a9-4880-9724-aed35451517a None None] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:32:17.497200 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee40cd72-18a9-4880-9724-aed35451517a None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:32:17.497200 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee40cd72-18a9-4880-9724-aed35451517a None None] PATH_INFO: `/` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:32:17.498511 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 514/1027] 10.222.0.104 () {54 vars in 923 bytes} [Tue Aug 9 16:32:17 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:32:17.503866 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1729d59b-8845-45d5-9065-b29beceed88b None None] REQUEST_METHOD: `POST` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:32:17.504351 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1729d59b-8845-45d5-9065-b29beceed88b None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:32:17.504455 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1729d59b-8845-45d5-9065-b29beceed88b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:32:17.524487 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.auth.core [None req-1729d59b-8845-45d5-9065-b29beceed88b None None] MFA Rules not processed for user `cfd1352d64de487ca4675cbe113e919f`. Rule list: `[]` (Enabled: `True`). {{(pid=87275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:32:17.526416 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.fernet_utils [None req-1729d59b-8845-45d5-9065-b29beceed88b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:32:17.536288 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 514/1028] 10.222.0.104 () {58 vars in 1020 bytes} [Tue Aug 9 16:32:17 2022] POST /identity/v3/auth/tokens => generated 2876 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 16:32:17.551219 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfcbbd1-38cb-4107-901c-240f557e1b95 None None] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:32:17.551506 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfcbbd1-38cb-4107-901c-240f557e1b95 None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:32:17.551782 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfcbbd1-38cb-4107-901c-240f557e1b95 None None] PATH_INFO: `/` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:32:17.553095 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 515/1029] 10.222.0.104 () {54 vars in 923 bytes} [Tue Aug 9 16:32:17 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:32:17.558287 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ae905c-a35c-4027-a155-46252a83aefc None None] REQUEST_METHOD: `POST` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:32:17.558799 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ae905c-a35c-4027-a155-46252a83aefc None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:32:17.559074 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ae905c-a35c-4027-a155-46252a83aefc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:32:17.578669 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.auth.core [None req-78ae905c-a35c-4027-a155-46252a83aefc None None] MFA Rules not processed for user `b4c33c3fc318484d9cdfae778d23f06a`. Rule list: `[]` (Enabled: `True`). {{(pid=87275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:32:17.579857 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.fernet_utils [None req-78ae905c-a35c-4027-a155-46252a83aefc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:32:17.588805 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 515/1030] 10.222.0.104 () {58 vars in 1020 bytes} [Tue Aug 9 16:32:17 2022] POST /identity/v3/auth/tokens => generated 2871 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 16:32:20.430767 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42db3847-84ad-4c62-8365-67c6ea45aa7a None None] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:32:20.431602 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42db3847-84ad-4c62-8365-67c6ea45aa7a None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:32:20.431602 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42db3847-84ad-4c62-8365-67c6ea45aa7a None None] PATH_INFO: `/` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:32:20.432791 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 516/1031] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 9 16:32:20 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:32:20.437872 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafbee8e-dd74-4099-94c2-9a3794731411 None None] REQUEST_METHOD: `POST` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:32:20.438340 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafbee8e-dd74-4099-94c2-9a3794731411 None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:32:20.438592 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafbee8e-dd74-4099-94c2-9a3794731411 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:32:20.457382 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.auth.core [None req-dafbee8e-dd74-4099-94c2-9a3794731411 None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:32:20.458600 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.fernet_utils [None req-dafbee8e-dd74-4099-94c2-9a3794731411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:32:20.466942 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 516/1032] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 9 16:32:20 2022] POST /identity/v3/auth/tokens => generated 2807 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 16:32:20.512228 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42db3847-84ad-4c62-8365-67c6ea45aa7a None None] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:32:20.527026 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42db3847-84ad-4c62-8365-67c6ea45aa7a None None] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:32:20.532193 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3de932-c3f9-4b3c-97e2-a6faae4a59d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4c33c3fc318484d9cdfae778d23f06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63557f0ff1ce4ae49899b4627bafd94e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:32:20.532778 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3de932-c3f9-4b3c-97e2-a6faae4a59d4 service nova] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:32:20.533050 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3de932-c3f9-4b3c-97e2-a6faae4a59d4 service nova] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:32:20.533314 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3de932-c3f9-4b3c-97e2-a6faae4a59d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:32:20.541187 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3de932-c3f9-4b3c-97e2-a6faae4a59d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:32:20.543322 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3de932-c3f9-4b3c-97e2-a6faae4a59d4 service nova] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:32:20.552441 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 517/1033] 10.222.0.104 () {60 vars in 1370 bytes} [Tue Aug 9 16:32:20 2022] GET /identity/v3/auth/tokens => generated 2807 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 16:32:21.509386 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a070277-ab50-4bc8-80a1-2bc03d6a4721 None None] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:32:21.510077 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a070277-ab50-4bc8-80a1-2bc03d6a4721 None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:32:21.510077 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a070277-ab50-4bc8-80a1-2bc03d6a4721 None None] PATH_INFO: `/` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:32:21.511348 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 517/1034] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 9 16:32:21 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:32:21.516215 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ac049a-0576-42f6-8234-6e28d1104e5a None None] REQUEST_METHOD: `POST` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:32:21.516641 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ac049a-0576-42f6-8234-6e28d1104e5a None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:32:21.516743 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ac049a-0576-42f6-8234-6e28d1104e5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:32:21.535685 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.auth.core [None req-52ac049a-0576-42f6-8234-6e28d1104e5a None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:32:21.537522 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.fernet_utils [None req-52ac049a-0576-42f6-8234-6e28d1104e5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:32:21.545653 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 518/1035] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 9 16:32:21 2022] POST /identity/v3/auth/tokens => generated 2807 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 16:32:21.773434 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a070277-ab50-4bc8-80a1-2bc03d6a4721 None None] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:32:21.787072 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a070277-ab50-4bc8-80a1-2bc03d6a4721 None None] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:32:21.792038 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94d1ae9-64d7-493f-96c9-3a36f639b87f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4c33c3fc318484d9cdfae778d23f06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63557f0ff1ce4ae49899b4627bafd94e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:32:21.793314 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94d1ae9-64d7-493f-96c9-3a36f639b87f service nova] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:32:21.793583 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94d1ae9-64d7-493f-96c9-3a36f639b87f service nova] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:32:21.793843 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94d1ae9-64d7-493f-96c9-3a36f639b87f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:32:21.801706 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94d1ae9-64d7-493f-96c9-3a36f639b87f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:32:21.803298 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94d1ae9-64d7-493f-96c9-3a36f639b87f service nova] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:32:21.816345 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 518/1036] 10.222.0.104 () {60 vars in 1370 bytes} [Tue Aug 9 16:32:21 2022] GET /identity/v3/auth/tokens => generated 2807 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 16:32:22.719233 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269804a3-19b0-4845-a85d-509abfdcfd26 None None] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:32:22.719794 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269804a3-19b0-4845-a85d-509abfdcfd26 None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:32:22.719794 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269804a3-19b0-4845-a85d-509abfdcfd26 None None] PATH_INFO: `/` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:32:22.721082 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 519/1037] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 9 16:32:22 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:32:22.726048 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ef600a-4d8e-4dc1-a37c-a5e6e542363c None None] REQUEST_METHOD: `POST` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:32:22.726461 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ef600a-4d8e-4dc1-a37c-a5e6e542363c None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:32:22.726617 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ef600a-4d8e-4dc1-a37c-a5e6e542363c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:32:22.746183 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.auth.core [None req-77ef600a-4d8e-4dc1-a37c-a5e6e542363c None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:32:22.747399 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.fernet_utils [None req-77ef600a-4d8e-4dc1-a37c-a5e6e542363c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:32:22.755119 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 519/1038] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 9 16:32:22 2022] POST /identity/v3/auth/tokens => generated 2807 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 16:32:22.914677 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269804a3-19b0-4845-a85d-509abfdcfd26 None None] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:32:22.928046 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269804a3-19b0-4845-a85d-509abfdcfd26 None None] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:32:22.933596 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c505b4bd-d9c3-41a2-ba37-34ca69364e1f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4c33c3fc318484d9cdfae778d23f06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63557f0ff1ce4ae49899b4627bafd94e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:32:22.934220 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c505b4bd-d9c3-41a2-ba37-34ca69364e1f service nova] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:32:22.934502 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c505b4bd-d9c3-41a2-ba37-34ca69364e1f service nova] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:32:22.934768 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c505b4bd-d9c3-41a2-ba37-34ca69364e1f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:32:22.942563 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c505b4bd-d9c3-41a2-ba37-34ca69364e1f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:32:22.944121 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c505b4bd-d9c3-41a2-ba37-34ca69364e1f service nova] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:32:22.953640 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 520/1039] 10.222.0.104 () {60 vars in 1370 bytes} [Tue Aug 9 16:32:22 2022] GET /identity/v3/auth/tokens => generated 2807 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 16:32:23.826426 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1034e2-3f42-4e83-8803-f3c02428db3f None None] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:32:23.826952 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1034e2-3f42-4e83-8803-f3c02428db3f None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:32:23.826952 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1034e2-3f42-4e83-8803-f3c02428db3f None None] PATH_INFO: `/` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:32:23.828229 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 520/1040] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 9 16:32:23 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:32:23.833212 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4d2578-2328-4fc7-95ad-00bf144736d9 None None] REQUEST_METHOD: `POST` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:32:23.833651 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4d2578-2328-4fc7-95ad-00bf144736d9 None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:32:23.833765 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4d2578-2328-4fc7-95ad-00bf144736d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:32:23.853202 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.auth.core [None req-ae4d2578-2328-4fc7-95ad-00bf144736d9 None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:32:23.854413 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.fernet_utils [None req-ae4d2578-2328-4fc7-95ad-00bf144736d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:32:23.861992 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 521/1041] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 9 16:32:23 2022] POST /identity/v3/auth/tokens => generated 2807 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 16:32:24.019390 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1034e2-3f42-4e83-8803-f3c02428db3f None None] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:32:24.033311 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1034e2-3f42-4e83-8803-f3c02428db3f None None] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:32:24.038519 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16da6def-8af1-4527-bc2a-7c5260c84dc6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4c33c3fc318484d9cdfae778d23f06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63557f0ff1ce4ae49899b4627bafd94e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:32:24.039111 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16da6def-8af1-4527-bc2a-7c5260c84dc6 service nova] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:32:24.039412 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16da6def-8af1-4527-bc2a-7c5260c84dc6 service nova] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:32:24.039679 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16da6def-8af1-4527-bc2a-7c5260c84dc6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:32:24.048439 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16da6def-8af1-4527-bc2a-7c5260c84dc6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:32:24.050059 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16da6def-8af1-4527-bc2a-7c5260c84dc6 service nova] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:32:24.062816 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 521/1042] 10.222.0.104 () {60 vars in 1370 bytes} [Tue Aug 9 16:32:24 2022] GET /identity/v3/auth/tokens => generated 2807 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 16:32:24.954735 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eae03fe-63a0-43eb-ba4a-e83e21319d44 None None] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:32:24.955524 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eae03fe-63a0-43eb-ba4a-e83e21319d44 None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:32:24.955524 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eae03fe-63a0-43eb-ba4a-e83e21319d44 None None] PATH_INFO: `/` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:32:24.956844 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 522/1043] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 9 16:32:24 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:32:24.961606 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab0b13a-8c11-457f-a0d4-0feed443166f None None] REQUEST_METHOD: `POST` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:32:24.962137 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab0b13a-8c11-457f-a0d4-0feed443166f None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:32:24.962294 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab0b13a-8c11-457f-a0d4-0feed443166f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:32:24.985795 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.auth.core [None req-1ab0b13a-8c11-457f-a0d4-0feed443166f None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:32:24.987065 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.fernet_utils [None req-1ab0b13a-8c11-457f-a0d4-0feed443166f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:32:24.995101 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 522/1044] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 9 16:32:24 2022] POST /identity/v3/auth/tokens => generated 2807 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 16:32:25.152305 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eae03fe-63a0-43eb-ba4a-e83e21319d44 None None] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:32:25.165646 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eae03fe-63a0-43eb-ba4a-e83e21319d44 None None] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:32:25.170718 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721677e8-2ca9-459d-a929-942030a3e19a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4c33c3fc318484d9cdfae778d23f06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63557f0ff1ce4ae49899b4627bafd94e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:32:25.171318 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721677e8-2ca9-459d-a929-942030a3e19a service nova] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:32:25.171597 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721677e8-2ca9-459d-a929-942030a3e19a service nova] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:32:25.171868 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721677e8-2ca9-459d-a929-942030a3e19a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:32:25.180219 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721677e8-2ca9-459d-a929-942030a3e19a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:32:25.181792 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721677e8-2ca9-459d-a929-942030a3e19a service nova] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:32:25.191137 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 523/1045] 10.222.0.104 () {60 vars in 1370 bytes} [Tue Aug 9 16:32:25 2022] GET /identity/v3/auth/tokens => generated 2807 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 16:32:26.004813 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a48eb3-9660-416d-9d88-fc993657969a None None] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:32:26.005382 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a48eb3-9660-416d-9d88-fc993657969a None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:32:26.005708 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a48eb3-9660-416d-9d88-fc993657969a None None] PATH_INFO: `/` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:32:26.007099 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 523/1046] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 9 16:32:26 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:32:26.011961 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41c9d56-d4f1-4af9-a296-fa0dc89f7d53 None None] REQUEST_METHOD: `POST` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:32:26.012400 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41c9d56-d4f1-4af9-a296-fa0dc89f7d53 None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:32:26.012528 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41c9d56-d4f1-4af9-a296-fa0dc89f7d53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:32:26.031834 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.auth.core [None req-c41c9d56-d4f1-4af9-a296-fa0dc89f7d53 None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:32:26.033027 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.fernet_utils [None req-c41c9d56-d4f1-4af9-a296-fa0dc89f7d53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:32:26.040883 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 524/1047] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 9 16:32:26 2022] POST /identity/v3/auth/tokens => generated 2807 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 16:32:26.207042 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a48eb3-9660-416d-9d88-fc993657969a None None] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:32:26.220756 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a48eb3-9660-416d-9d88-fc993657969a None None] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:32:26.225822 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556fccce-9dee-4d5f-902c-d90e0bdbdda1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4c33c3fc318484d9cdfae778d23f06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63557f0ff1ce4ae49899b4627bafd94e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:32:26.226449 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556fccce-9dee-4d5f-902c-d90e0bdbdda1 service nova] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:32:26.226731 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556fccce-9dee-4d5f-902c-d90e0bdbdda1 service nova] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:32:26.227020 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556fccce-9dee-4d5f-902c-d90e0bdbdda1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:32:26.235753 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556fccce-9dee-4d5f-902c-d90e0bdbdda1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:32:26.237362 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556fccce-9dee-4d5f-902c-d90e0bdbdda1 service nova] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:32:26.246603 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 524/1048] 10.222.0.104 () {60 vars in 1370 bytes} [Tue Aug 9 16:32:26 2022] GET /identity/v3/auth/tokens => generated 2807 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 16:32:27.054400 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a58a172-e165-41d9-8978-0c02d4092a19 None None] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:32:27.054940 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a58a172-e165-41d9-8978-0c02d4092a19 None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:32:27.054940 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a58a172-e165-41d9-8978-0c02d4092a19 None None] PATH_INFO: `/` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:32:27.056363 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 525/1049] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 9 16:32:27 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:32:27.061807 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c956659d-d048-4abc-b71a-c5bbe7345e93 None None] REQUEST_METHOD: `POST` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:32:27.062266 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c956659d-d048-4abc-b71a-c5bbe7345e93 None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:32:27.062363 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c956659d-d048-4abc-b71a-c5bbe7345e93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:32:27.082378 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.auth.core [None req-c956659d-d048-4abc-b71a-c5bbe7345e93 None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:32:27.083553 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.fernet_utils [None req-c956659d-d048-4abc-b71a-c5bbe7345e93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:32:27.091339 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 525/1050] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 9 16:32:27 2022] POST /identity/v3/auth/tokens => generated 2807 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 16:32:27.248768 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a58a172-e165-41d9-8978-0c02d4092a19 None None] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:32:27.263534 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a58a172-e165-41d9-8978-0c02d4092a19 None None] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:32:27.268745 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70d1e40-c3cd-4498-b33a-73595f8f1937 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4c33c3fc318484d9cdfae778d23f06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63557f0ff1ce4ae49899b4627bafd94e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:32:27.269375 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70d1e40-c3cd-4498-b33a-73595f8f1937 service nova] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:32:27.269651 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70d1e40-c3cd-4498-b33a-73595f8f1937 service nova] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:32:27.269996 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70d1e40-c3cd-4498-b33a-73595f8f1937 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:32:27.278367 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70d1e40-c3cd-4498-b33a-73595f8f1937 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:32:27.279964 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70d1e40-c3cd-4498-b33a-73595f8f1937 service nova] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:32:27.289260 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 526/1051] 10.222.0.104 () {60 vars in 1370 bytes} [Tue Aug 9 16:32:27 2022] GET /identity/v3/auth/tokens => generated 2807 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 16:32:28.107495 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0fbc02-ec38-4b1c-9f28-99f64ef52611 None None] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:32:28.108044 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0fbc02-ec38-4b1c-9f28-99f64ef52611 None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:32:28.108044 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0fbc02-ec38-4b1c-9f28-99f64ef52611 None None] PATH_INFO: `/` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:32:28.109268 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 526/1052] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 9 16:32:28 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:32:28.114350 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911669de-1f54-414c-8280-c770e8b13280 None None] REQUEST_METHOD: `POST` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:32:28.114789 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911669de-1f54-414c-8280-c770e8b13280 None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:32:28.114994 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911669de-1f54-414c-8280-c770e8b13280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:32:28.134401 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.auth.core [None req-911669de-1f54-414c-8280-c770e8b13280 None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:32:28.135606 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.fernet_utils [None req-911669de-1f54-414c-8280-c770e8b13280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:32:28.144143 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 527/1053] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 9 16:32:28 2022] POST /identity/v3/auth/tokens => generated 2807 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 16:32:28.301469 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0fbc02-ec38-4b1c-9f28-99f64ef52611 None None] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:32:28.316070 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0fbc02-ec38-4b1c-9f28-99f64ef52611 None None] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:32:28.321022 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d58a36-680f-40af-9537-346da8e5818b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4c33c3fc318484d9cdfae778d23f06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63557f0ff1ce4ae49899b4627bafd94e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:32:28.321614 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d58a36-680f-40af-9537-346da8e5818b service nova] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:32:28.321887 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d58a36-680f-40af-9537-346da8e5818b service nova] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:32:28.322186 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d58a36-680f-40af-9537-346da8e5818b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:32:28.330340 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d58a36-680f-40af-9537-346da8e5818b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:32:28.332177 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d58a36-680f-40af-9537-346da8e5818b service nova] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:32:28.341567 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 527/1054] 10.222.0.104 () {60 vars in 1370 bytes} [Tue Aug 9 16:32:28 2022] GET /identity/v3/auth/tokens => generated 2807 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 16:32:29.153932 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0644c677-4570-4614-971d-cd9362ec356c None None] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:32:29.154444 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0644c677-4570-4614-971d-cd9362ec356c None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:32:29.154444 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0644c677-4570-4614-971d-cd9362ec356c None None] PATH_INFO: `/` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:32:29.155710 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 528/1055] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 9 16:32:29 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:32:29.160468 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf74b64-9540-450a-bb3a-5b2872ad730a None None] REQUEST_METHOD: `POST` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:32:29.160873 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf74b64-9540-450a-bb3a-5b2872ad730a None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:32:29.161009 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf74b64-9540-450a-bb3a-5b2872ad730a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:32:29.179900 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.auth.core [None req-cdf74b64-9540-450a-bb3a-5b2872ad730a None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:32:29.181131 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.fernet_utils [None req-cdf74b64-9540-450a-bb3a-5b2872ad730a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:32:29.189580 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 528/1056] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 9 16:32:29 2022] POST /identity/v3/auth/tokens => generated 2807 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 16:32:29.344438 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0644c677-4570-4614-971d-cd9362ec356c None None] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:32:29.358192 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0644c677-4570-4614-971d-cd9362ec356c None None] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:32:29.363189 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfa7b84-3591-4ef0-9021-308d10ccbad9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4c33c3fc318484d9cdfae778d23f06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63557f0ff1ce4ae49899b4627bafd94e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:32:29.363774 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfa7b84-3591-4ef0-9021-308d10ccbad9 service nova] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:32:29.364049 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfa7b84-3591-4ef0-9021-308d10ccbad9 service nova] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:32:29.364315 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfa7b84-3591-4ef0-9021-308d10ccbad9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:32:29.372253 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfa7b84-3591-4ef0-9021-308d10ccbad9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:32:29.373810 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfa7b84-3591-4ef0-9021-308d10ccbad9 service nova] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:32:29.382996 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 529/1057] 10.222.0.104 () {60 vars in 1370 bytes} [Tue Aug 9 16:32:29 2022] GET /identity/v3/auth/tokens => generated 2807 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 16:32:31.550584 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276dee91-4144-40d5-84d6-165b2b65f591 None None] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:32:31.551022 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276dee91-4144-40d5-84d6-165b2b65f591 None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:32:31.551122 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276dee91-4144-40d5-84d6-165b2b65f591 None None] PATH_INFO: `/` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:32:31.552461 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 529/1058] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 9 16:32:31 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:32:31.557704 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd934fa-955c-473e-a773-0e615b296b9e None None] REQUEST_METHOD: `POST` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:32:31.558183 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd934fa-955c-473e-a773-0e615b296b9e None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:32:31.558403 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd934fa-955c-473e-a773-0e615b296b9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:32:31.577164 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.auth.core [None req-ffd934fa-955c-473e-a773-0e615b296b9e None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:32:31.578379 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.fernet_utils [None req-ffd934fa-955c-473e-a773-0e615b296b9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:32:31.586249 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 530/1059] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 9 16:32:31 2022] POST /identity/v3/auth/tokens => generated 2807 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 16:32:31.626354 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276dee91-4144-40d5-84d6-165b2b65f591 None None] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:32:31.636893 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276dee91-4144-40d5-84d6-165b2b65f591 None None] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:32:31.640306 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1651cc-16ac-4eb5-82d3-b17bc62e53b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da49ba8d1a21406eac55503b42fea65b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63557f0ff1ce4ae49899b4627bafd94e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:32:31.640884 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1651cc-16ac-4eb5-82d3-b17bc62e53b6 service neutron] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:32:31.641157 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1651cc-16ac-4eb5-82d3-b17bc62e53b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:32:31.641426 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1651cc-16ac-4eb5-82d3-b17bc62e53b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:32:31.650144 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1651cc-16ac-4eb5-82d3-b17bc62e53b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:32:31.651552 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1651cc-16ac-4eb5-82d3-b17bc62e53b6 service neutron] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:32:31.661145 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 530/1060] 10.222.0.104 () {60 vars in 1370 bytes} [Tue Aug 9 16:32:31 2022] GET /identity/v3/auth/tokens => generated 2807 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 16:32:34.088638 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b719eab-024d-4ce6-9ef0-f842eb995138 None None] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:32:34.089215 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b719eab-024d-4ce6-9ef0-f842eb995138 None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:32:34.089327 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b719eab-024d-4ce6-9ef0-f842eb995138 None None] PATH_INFO: `/` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:32:34.090643 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 531/1061] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 9 16:32:34 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:32:34.096046 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720e8f88-68a9-40a7-be56-81c51d198718 None None] REQUEST_METHOD: `POST` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:32:34.096497 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720e8f88-68a9-40a7-be56-81c51d198718 None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:32:34.096645 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720e8f88-68a9-40a7-be56-81c51d198718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:32:34.115703 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.auth.core [None req-720e8f88-68a9-40a7-be56-81c51d198718 None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:32:34.116873 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.fernet_utils [None req-720e8f88-68a9-40a7-be56-81c51d198718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:32:34.125409 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 531/1062] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 9 16:32:34 2022] POST /identity/v3/auth/tokens => generated 2807 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 16:32:34.163696 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b719eab-024d-4ce6-9ef0-f842eb995138 None None] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:32:34.174961 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b719eab-024d-4ce6-9ef0-f842eb995138 None None] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:32:34.178473 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cd6007-6a7e-45bc-aff8-8c194899ff05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da49ba8d1a21406eac55503b42fea65b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63557f0ff1ce4ae49899b4627bafd94e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:32:34.179061 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cd6007-6a7e-45bc-aff8-8c194899ff05 service neutron] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:32:34.179366 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cd6007-6a7e-45bc-aff8-8c194899ff05 service neutron] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:32:34.179638 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cd6007-6a7e-45bc-aff8-8c194899ff05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:32:34.188967 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cd6007-6a7e-45bc-aff8-8c194899ff05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:32:34.190421 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cd6007-6a7e-45bc-aff8-8c194899ff05 service neutron] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:32:34.199696 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 532/1063] 10.222.0.104 () {60 vars in 1370 bytes} [Tue Aug 9 16:32:34 2022] GET /identity/v3/auth/tokens => generated 2807 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 16:32:36.767545 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c23f72b-4bcd-441d-a550-90c1ae921b2f None None] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:32:36.767956 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c23f72b-4bcd-441d-a550-90c1ae921b2f None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:32:36.768085 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c23f72b-4bcd-441d-a550-90c1ae921b2f None None] PATH_INFO: `/` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:32:36.769448 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 532/1064] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 9 16:32:36 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:32:36.774789 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5405a9-d2c3-4fc6-987f-93c7c9f84b8b None None] REQUEST_METHOD: `POST` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:32:36.775238 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5405a9-d2c3-4fc6-987f-93c7c9f84b8b None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:32:36.775344 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5405a9-d2c3-4fc6-987f-93c7c9f84b8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:32:36.794970 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.auth.core [None req-cf5405a9-d2c3-4fc6-987f-93c7c9f84b8b None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:32:36.796169 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.fernet_utils [None req-cf5405a9-d2c3-4fc6-987f-93c7c9f84b8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:32:36.803878 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 533/1065] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 9 16:32:36 2022] POST /identity/v3/auth/tokens => generated 2807 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 16:32:36.843935 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c23f72b-4bcd-441d-a550-90c1ae921b2f None None] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:32:36.854305 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c23f72b-4bcd-441d-a550-90c1ae921b2f None None] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:32:36.857673 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f12922-b00e-4bc6-bccd-4faa707fb9f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da49ba8d1a21406eac55503b42fea65b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63557f0ff1ce4ae49899b4627bafd94e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:32:36.858287 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f12922-b00e-4bc6-bccd-4faa707fb9f0 service neutron] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:32:36.858579 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f12922-b00e-4bc6-bccd-4faa707fb9f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:32:36.858823 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f12922-b00e-4bc6-bccd-4faa707fb9f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:32:36.867433 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f12922-b00e-4bc6-bccd-4faa707fb9f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:32:36.868834 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f12922-b00e-4bc6-bccd-4faa707fb9f0 service neutron] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:32:36.878554 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 533/1066] 10.222.0.104 () {60 vars in 1370 bytes} [Tue Aug 9 16:32:36 2022] GET /identity/v3/auth/tokens => generated 2807 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 16:32:39.276364 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955e4c8e-03ca-4093-8bc5-afbe7a64b163 None None] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:32:39.277452 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955e4c8e-03ca-4093-8bc5-afbe7a64b163 None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:32:39.277552 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955e4c8e-03ca-4093-8bc5-afbe7a64b163 None None] PATH_INFO: `/` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:32:39.278858 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 534/1067] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 9 16:32:39 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 09 16:32:39.284084 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46488b16-4f01-41c8-9590-6d0ded80120e None None] REQUEST_METHOD: `POST` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:32:39.284528 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46488b16-4f01-41c8-9590-6d0ded80120e None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:32:39.284635 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46488b16-4f01-41c8-9590-6d0ded80120e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:32:39.303548 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.auth.core [None req-46488b16-4f01-41c8-9590-6d0ded80120e None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:32:39.304722 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.fernet_utils [None req-46488b16-4f01-41c8-9590-6d0ded80120e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:32:39.312605 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 534/1068] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 9 16:32:39 2022] POST /identity/v3/auth/tokens => generated 2807 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 16:32:39.353669 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955e4c8e-03ca-4093-8bc5-afbe7a64b163 None None] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:32:39.364865 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955e4c8e-03ca-4093-8bc5-afbe7a64b163 None None] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:32:39.368342 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1583906-697a-4ba5-8f5d-ecd095d93ced service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da49ba8d1a21406eac55503b42fea65b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63557f0ff1ce4ae49899b4627bafd94e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:32:39.368926 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1583906-697a-4ba5-8f5d-ecd095d93ced service neutron] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:32:39.369201 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1583906-697a-4ba5-8f5d-ecd095d93ced service neutron] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:32:39.369467 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1583906-697a-4ba5-8f5d-ecd095d93ced service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:32:39.378703 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1583906-697a-4ba5-8f5d-ecd095d93ced service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:32:39.380115 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1583906-697a-4ba5-8f5d-ecd095d93ced service neutron] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:32:39.389182 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 535/1069] 10.222.0.104 () {60 vars in 1370 bytes} [Tue Aug 9 16:32:39 2022] GET /identity/v3/auth/tokens => generated 2807 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 16:32:41.841723 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d52ae9-f108-4e60-9efc-e56a6fb1a8fd None None] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:32:41.842274 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d52ae9-f108-4e60-9efc-e56a6fb1a8fd None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:32:41.842274 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d52ae9-f108-4e60-9efc-e56a6fb1a8fd None None] PATH_INFO: `/` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:32:41.843534 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 535/1070] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 9 16:32:41 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:32:41.849204 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d934f47f-c908-4d5f-bce9-3b740c21708e None None] REQUEST_METHOD: `POST` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:32:41.849600 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d934f47f-c908-4d5f-bce9-3b740c21708e None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:32:41.849743 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d934f47f-c908-4d5f-bce9-3b740c21708e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:32:41.870345 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.auth.core [None req-d934f47f-c908-4d5f-bce9-3b740c21708e None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:32:41.872172 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.fernet_utils [None req-d934f47f-c908-4d5f-bce9-3b740c21708e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:32:41.880662 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 536/1071] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 9 16:32:41 2022] POST /identity/v3/auth/tokens => generated 2807 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 16:32:41.920003 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d52ae9-f108-4e60-9efc-e56a6fb1a8fd None None] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:32:41.930538 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d52ae9-f108-4e60-9efc-e56a6fb1a8fd None None] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:32:41.934374 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3d223e-aa0d-4df8-89d1-24fa7c028179 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da49ba8d1a21406eac55503b42fea65b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63557f0ff1ce4ae49899b4627bafd94e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:32:41.934998 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3d223e-aa0d-4df8-89d1-24fa7c028179 service neutron] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:32:41.935272 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3d223e-aa0d-4df8-89d1-24fa7c028179 service neutron] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:32:41.935541 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3d223e-aa0d-4df8-89d1-24fa7c028179 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:32:41.944378 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3d223e-aa0d-4df8-89d1-24fa7c028179 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:32:41.945877 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3d223e-aa0d-4df8-89d1-24fa7c028179 service neutron] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:32:41.955420 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 536/1072] 10.222.0.104 () {60 vars in 1370 bytes} [Tue Aug 9 16:32:41 2022] GET /identity/v3/auth/tokens => generated 2807 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 16:32:44.343541 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f306dd-db19-424e-8dfb-d3f0df5474eb None None] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:32:44.344063 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f306dd-db19-424e-8dfb-d3f0df5474eb None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:32:44.344063 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f306dd-db19-424e-8dfb-d3f0df5474eb None None] PATH_INFO: `/` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:32:44.345343 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 537/1073] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 9 16:32:44 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:32:44.350677 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ea902b-516d-49d4-97e6-dcf6701a1677 None None] REQUEST_METHOD: `POST` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:32:44.351097 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ea902b-516d-49d4-97e6-dcf6701a1677 None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:32:44.351222 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ea902b-516d-49d4-97e6-dcf6701a1677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:32:44.370130 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.auth.core [None req-71ea902b-516d-49d4-97e6-dcf6701a1677 None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:32:44.371840 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.fernet_utils [None req-71ea902b-516d-49d4-97e6-dcf6701a1677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:32:44.379449 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 537/1074] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 9 16:32:44 2022] POST /identity/v3/auth/tokens => generated 2807 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 16:32:44.420139 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f306dd-db19-424e-8dfb-d3f0df5474eb None None] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:32:44.430735 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f306dd-db19-424e-8dfb-d3f0df5474eb None None] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:32:44.434711 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2657814-d060-4ec7-a22f-4a1a557c8139 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da49ba8d1a21406eac55503b42fea65b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63557f0ff1ce4ae49899b4627bafd94e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:32:44.435295 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2657814-d060-4ec7-a22f-4a1a557c8139 service neutron] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:32:44.435567 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2657814-d060-4ec7-a22f-4a1a557c8139 service neutron] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:32:44.435832 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2657814-d060-4ec7-a22f-4a1a557c8139 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:32:44.444397 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2657814-d060-4ec7-a22f-4a1a557c8139 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:32:44.445801 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2657814-d060-4ec7-a22f-4a1a557c8139 service neutron] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:32:44.455544 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 538/1075] 10.222.0.104 () {60 vars in 1370 bytes} [Tue Aug 9 16:32:44 2022] GET /identity/v3/auth/tokens => generated 2807 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 16:32:46.790324 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7289f7-212f-49e4-a168-699694df82e8 None None] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:32:46.790853 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7289f7-212f-49e4-a168-699694df82e8 None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:32:46.790943 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7289f7-212f-49e4-a168-699694df82e8 None None] PATH_INFO: `/` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:32:46.792268 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 538/1076] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 9 16:32:46 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:32:46.797967 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de158e9d-77f8-47bb-a1f2-10436262fc38 None None] REQUEST_METHOD: `POST` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:32:46.798372 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de158e9d-77f8-47bb-a1f2-10436262fc38 None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:32:46.798529 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de158e9d-77f8-47bb-a1f2-10436262fc38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:32:46.805731 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=70 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:32:46.818668 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.auth.core [None req-de158e9d-77f8-47bb-a1f2-10436262fc38 None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:32:46.819864 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.fernet_utils [None req-de158e9d-77f8-47bb-a1f2-10436262fc38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:32:46.827583 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 539/1077] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 9 16:32:46 2022] POST /identity/v3/auth/tokens => generated 2807 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 16:32:46.866357 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7289f7-212f-49e4-a168-699694df82e8 None None] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:32:46.872244 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=73 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:32:46.878472 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7289f7-212f-49e4-a168-699694df82e8 None None] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:32:46.881939 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d70f193-3f9a-435a-a974-8b5ace567ecf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da49ba8d1a21406eac55503b42fea65b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63557f0ff1ce4ae49899b4627bafd94e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:32:46.882520 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d70f193-3f9a-435a-a974-8b5ace567ecf service neutron] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:32:46.882795 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d70f193-3f9a-435a-a974-8b5ace567ecf service neutron] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:32:46.883125 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d70f193-3f9a-435a-a974-8b5ace567ecf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:32:46.891722 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d70f193-3f9a-435a-a974-8b5ace567ecf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:32:46.893141 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d70f193-3f9a-435a-a974-8b5ace567ecf service neutron] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:32:46.902338 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 539/1078] 10.222.0.104 () {60 vars in 1370 bytes} [Tue Aug 9 16:32:46 2022] GET /identity/v3/auth/tokens => generated 2807 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 16:32:49.274099 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94ecac7-247a-4535-bdb0-d24bd309519d None None] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:32:49.274708 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94ecac7-247a-4535-bdb0-d24bd309519d None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:32:49.274708 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94ecac7-247a-4535-bdb0-d24bd309519d None None] PATH_INFO: `/` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:32:49.275942 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 540/1079] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 9 16:32:49 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:32:49.281589 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0658a9-5f0a-4d02-a086-0800637a492d None None] REQUEST_METHOD: `POST` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:32:49.282023 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0658a9-5f0a-4d02-a086-0800637a492d None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:32:49.282183 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0658a9-5f0a-4d02-a086-0800637a492d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:32:49.301155 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.auth.core [None req-2a0658a9-5f0a-4d02-a086-0800637a492d None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:32:49.302375 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.fernet_utils [None req-2a0658a9-5f0a-4d02-a086-0800637a492d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:32:49.310677 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 540/1080] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 9 16:32:49 2022] POST /identity/v3/auth/tokens => generated 2807 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 16:32:49.348895 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94ecac7-247a-4535-bdb0-d24bd309519d None None] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:32:49.359859 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94ecac7-247a-4535-bdb0-d24bd309519d None None] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:32:49.363338 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2657c0-836f-45a8-be16-143859063f13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da49ba8d1a21406eac55503b42fea65b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63557f0ff1ce4ae49899b4627bafd94e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:32:49.363916 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2657c0-836f-45a8-be16-143859063f13 service neutron] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:32:49.364190 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2657c0-836f-45a8-be16-143859063f13 service neutron] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:32:49.364458 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2657c0-836f-45a8-be16-143859063f13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:32:49.373708 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2657c0-836f-45a8-be16-143859063f13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:32:49.375154 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2657c0-836f-45a8-be16-143859063f13 service neutron] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:32:49.384300 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 541/1081] 10.222.0.104 () {60 vars in 1370 bytes} [Tue Aug 9 16:32:49 2022] GET /identity/v3/auth/tokens => generated 2807 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 16:32:51.689011 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74575b79-38bc-487d-8356-ce954dd01693 None None] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:32:51.689583 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74575b79-38bc-487d-8356-ce954dd01693 None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:32:51.689583 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74575b79-38bc-487d-8356-ce954dd01693 None None] PATH_INFO: `/` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:32:51.690917 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 541/1082] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 9 16:32:51 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:32:51.696205 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66d2c47-ee84-4836-86c0-79a278b4d9e4 None None] REQUEST_METHOD: `POST` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:32:51.696657 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66d2c47-ee84-4836-86c0-79a278b4d9e4 None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:32:51.696767 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66d2c47-ee84-4836-86c0-79a278b4d9e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:32:51.716818 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.auth.core [None req-f66d2c47-ee84-4836-86c0-79a278b4d9e4 None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:32:51.718064 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.fernet_utils [None req-f66d2c47-ee84-4836-86c0-79a278b4d9e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:32:51.725726 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 542/1083] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 9 16:32:51 2022] POST /identity/v3/auth/tokens => generated 2807 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 16:32:51.763410 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74575b79-38bc-487d-8356-ce954dd01693 None None] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:32:51.774044 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74575b79-38bc-487d-8356-ce954dd01693 None None] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:32:51.778095 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c2f076-cdd1-4229-9fc4-bb63a30ce887 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da49ba8d1a21406eac55503b42fea65b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63557f0ff1ce4ae49899b4627bafd94e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:32:51.778687 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c2f076-cdd1-4229-9fc4-bb63a30ce887 service neutron] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:32:51.778965 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c2f076-cdd1-4229-9fc4-bb63a30ce887 service neutron] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:32:51.779235 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c2f076-cdd1-4229-9fc4-bb63a30ce887 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:32:51.788058 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c2f076-cdd1-4229-9fc4-bb63a30ce887 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:32:51.789477 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c2f076-cdd1-4229-9fc4-bb63a30ce887 service neutron] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:32:51.799330 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 542/1084] 10.222.0.104 () {60 vars in 1370 bytes} [Tue Aug 9 16:32:51 2022] GET /identity/v3/auth/tokens => generated 2807 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 16:32:54.090685 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a322b133-2da8-410e-8ba7-141ca426a71c None None] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:32:54.091252 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a322b133-2da8-410e-8ba7-141ca426a71c None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:32:54.091252 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a322b133-2da8-410e-8ba7-141ca426a71c None None] PATH_INFO: `/` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:32:54.092531 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 543/1085] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 9 16:32:54 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:32:54.097720 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882b3193-047d-4ecb-973e-f0101562fe78 None None] REQUEST_METHOD: `POST` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:32:54.098270 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882b3193-047d-4ecb-973e-f0101562fe78 None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:32:54.098407 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882b3193-047d-4ecb-973e-f0101562fe78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:32:54.118337 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.auth.core [None req-882b3193-047d-4ecb-973e-f0101562fe78 None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:32:54.119594 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.fernet_utils [None req-882b3193-047d-4ecb-973e-f0101562fe78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:32:54.127379 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 543/1086] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 9 16:32:54 2022] POST /identity/v3/auth/tokens => generated 2807 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 16:32:54.165270 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a322b133-2da8-410e-8ba7-141ca426a71c None None] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:32:54.176300 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a322b133-2da8-410e-8ba7-141ca426a71c None None] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:32:54.179719 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adc4ee3-3816-4c26-8f92-6d64f9937ccb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da49ba8d1a21406eac55503b42fea65b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63557f0ff1ce4ae49899b4627bafd94e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:32:54.180304 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adc4ee3-3816-4c26-8f92-6d64f9937ccb service neutron] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:32:54.180575 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adc4ee3-3816-4c26-8f92-6d64f9937ccb service neutron] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:32:54.180839 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adc4ee3-3816-4c26-8f92-6d64f9937ccb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:32:54.190168 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adc4ee3-3816-4c26-8f92-6d64f9937ccb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:32:54.191593 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adc4ee3-3816-4c26-8f92-6d64f9937ccb service neutron] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:32:54.200869 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 544/1087] 10.222.0.104 () {60 vars in 1370 bytes} [Tue Aug 9 16:32:54 2022] GET /identity/v3/auth/tokens => generated 2807 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 16:33:04.113672 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=17 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:33:04.196773 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=17 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:33:18.279538 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683c1c6c-15ec-43d0-a9ce-13297280568e None None] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:33:18.280167 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683c1c6c-15ec-43d0-a9ce-13297280568e None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:33:18.280167 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683c1c6c-15ec-43d0-a9ce-13297280568e None None] PATH_INFO: `/` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:33:18.281313 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 544/1088] 10.222.0.104 () {54 vars in 932 bytes} [Tue Aug 9 16:33:18 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:33:18.286490 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21e514e-077b-4e48-87eb-99dedc0ef612 None None] REQUEST_METHOD: `POST` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:33:18.286933 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21e514e-077b-4e48-87eb-99dedc0ef612 None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:33:18.287065 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21e514e-077b-4e48-87eb-99dedc0ef612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:33:18.306509 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.auth.core [None req-e21e514e-077b-4e48-87eb-99dedc0ef612 None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:33:18.307684 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.fernet_utils [None req-e21e514e-077b-4e48-87eb-99dedc0ef612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:33:18.315333 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 545/1089] 10.222.0.104 () {58 vars in 1029 bytes} [Tue Aug 9 16:33:18 2022] POST /identity/v3/auth/tokens => generated 2807 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 16:33:18.365636 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c8ff28-040d-4307-83f6-1ddd4bc647ab None None] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:33:18.365936 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c8ff28-040d-4307-83f6-1ddd4bc647ab None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:33:18.366276 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c8ff28-040d-4307-83f6-1ddd4bc647ab None None] PATH_INFO: `/` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:33:18.367615 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 545/1090] 10.222.0.104 () {54 vars in 972 bytes} [Tue Aug 9 16:33:18 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:33:18.373303 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5758aae3-8d64-4987-9ed7-c1c7e9018e5b None None] REQUEST_METHOD: `POST` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:33:18.373583 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5758aae3-8d64-4987-9ed7-c1c7e9018e5b None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:33:18.373853 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5758aae3-8d64-4987-9ed7-c1c7e9018e5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:33:18.392711 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.auth.core [None req-5758aae3-8d64-4987-9ed7-c1c7e9018e5b None None] MFA Rules not processed for user `717261252a9a44de8a71c10fda7082b0`. Rule list: `[]` (Enabled: `True`). {{(pid=87276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:33:18.394078 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.fernet_utils [None req-5758aae3-8d64-4987-9ed7-c1c7e9018e5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:33:18.400366 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 546/1091] 10.222.0.104 () {58 vars in 1069 bytes} [Tue Aug 9 16:33:18 2022] POST /identity/v3/auth/tokens => generated 2688 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 16:33:18.407425 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c8ff28-040d-4307-83f6-1ddd4bc647ab None None] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:33:18.418490 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c8ff28-040d-4307-83f6-1ddd4bc647ab None None] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:33:18.422012 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919eb9fd-df14-40b0-9dcf-5327205dded8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '717261252a9a44de8a71c10fda7082b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63557f0ff1ce4ae49899b4627bafd94e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:33:18.422592 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919eb9fd-df14-40b0-9dcf-5327205dded8 service glance] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:33:18.422867 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919eb9fd-df14-40b0-9dcf-5327205dded8 service glance] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:33:18.423134 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919eb9fd-df14-40b0-9dcf-5327205dded8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:33:18.431799 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919eb9fd-df14-40b0-9dcf-5327205dded8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:33:18.433273 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919eb9fd-df14-40b0-9dcf-5327205dded8 service glance] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:33:18.442865 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 546/1092] 10.222.0.104 () {60 vars in 1370 bytes} [Tue Aug 9 16:33:18 2022] GET /identity/v3/auth/tokens => generated 2807 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 16:33:20.786191 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7da89b0-811f-47cb-be0b-38d462212d12 None None] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:33:20.786695 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7da89b0-811f-47cb-be0b-38d462212d12 None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:33:20.786695 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7da89b0-811f-47cb-be0b-38d462212d12 None None] PATH_INFO: `/` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:33:20.788069 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 547/1093] 10.222.0.104 () {54 vars in 932 bytes} [Tue Aug 9 16:33:20 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:33:20.793927 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076831e1-b91d-4625-aff8-fff332021653 None None] REQUEST_METHOD: `POST` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:33:20.794349 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076831e1-b91d-4625-aff8-fff332021653 None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:33:20.794452 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076831e1-b91d-4625-aff8-fff332021653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:33:20.813405 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.auth.core [None req-076831e1-b91d-4625-aff8-fff332021653 None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:33:20.814619 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.fernet_utils [None req-076831e1-b91d-4625-aff8-fff332021653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:33:20.822573 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 547/1094] 10.222.0.104 () {58 vars in 1029 bytes} [Tue Aug 9 16:33:20 2022] POST /identity/v3/auth/tokens => generated 2807 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 16:33:20.846482 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7da89b0-811f-47cb-be0b-38d462212d12 None None] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:33:20.859389 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7da89b0-811f-47cb-be0b-38d462212d12 None None] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:33:20.863965 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f54e51-a967-4c9a-bd67-8256c878bd33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce95c8faa1d4165b111ca9c55852804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:33:20.864544 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f54e51-a967-4c9a-bd67-8256c878bd33 admin admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:33:20.864820 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f54e51-a967-4c9a-bd67-8256c878bd33 admin admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:33:20.865200 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f54e51-a967-4c9a-bd67-8256c878bd33 admin admin] PATH_INFO: `/v3/projects` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:33:20.865839 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f54e51-a967-4c9a-bd67-8256c878bd33 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:33:20.867637 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: WARNING py.warnings [None req-40f54e51-a967-4c9a-bd67-8256c878bd33 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 09 16:33:20.867637 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: warnings.warn(msg) Aug 09 16:33:20.867637 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: Aug 09 16:33:20.868923 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f54e51-a967-4c9a-bd67-8256c878bd33 admin admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:33:20.887078 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 548/1095] 10.222.0.104 () {56 vars in 1113 bytes} [Tue Aug 9 16:33:20 2022] GET /identity/v3/projects => generated 1612 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 16:33:23.190669 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee830a65-9144-4f39-ad46-bccbe8bda86b None None] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:33:23.191206 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee830a65-9144-4f39-ad46-bccbe8bda86b None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:33:23.191206 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee830a65-9144-4f39-ad46-bccbe8bda86b None None] PATH_INFO: `/` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:33:23.192537 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 548/1096] 10.222.0.104 () {54 vars in 932 bytes} [Tue Aug 9 16:33:23 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:33:23.197895 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43e851e-71c4-4f20-a91a-9584ca788d59 None None] REQUEST_METHOD: `POST` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:33:23.198313 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43e851e-71c4-4f20-a91a-9584ca788d59 None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:33:23.198478 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43e851e-71c4-4f20-a91a-9584ca788d59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:33:23.219443 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.auth.core [None req-d43e851e-71c4-4f20-a91a-9584ca788d59 None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:33:23.220692 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.fernet_utils [None req-d43e851e-71c4-4f20-a91a-9584ca788d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:33:23.228536 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 549/1097] 10.222.0.104 () {58 vars in 1029 bytes} [Tue Aug 9 16:33:23 2022] POST /identity/v3/auth/tokens => generated 2807 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 16:33:23.273426 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee830a65-9144-4f39-ad46-bccbe8bda86b None None] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:33:23.289123 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee830a65-9144-4f39-ad46-bccbe8bda86b None None] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:33:23.295563 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35fdb82-ca56-4f5f-9275-d925a96c963c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4c33c3fc318484d9cdfae778d23f06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63557f0ff1ce4ae49899b4627bafd94e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:33:23.296160 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35fdb82-ca56-4f5f-9275-d925a96c963c service nova] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:33:23.296433 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35fdb82-ca56-4f5f-9275-d925a96c963c service nova] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:33:23.296701 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35fdb82-ca56-4f5f-9275-d925a96c963c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:33:23.304710 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35fdb82-ca56-4f5f-9275-d925a96c963c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:33:23.306325 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35fdb82-ca56-4f5f-9275-d925a96c963c service nova] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:33:23.315596 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 549/1098] 10.222.0.104 () {60 vars in 1370 bytes} [Tue Aug 9 16:33:23 2022] GET /identity/v3/auth/tokens => generated 2807 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 16:33:25.803779 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aade0057-5482-4981-ad03-94be317fccb4 None None] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:33:25.804299 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aade0057-5482-4981-ad03-94be317fccb4 None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:33:25.804396 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aade0057-5482-4981-ad03-94be317fccb4 None None] PATH_INFO: `/` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:33:25.805654 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 550/1099] 10.222.0.104 () {54 vars in 932 bytes} [Tue Aug 9 16:33:25 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:33:25.811534 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2cbdf3-623e-451c-befb-76f980764c9c None None] REQUEST_METHOD: `POST` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:33:25.811940 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2cbdf3-623e-451c-befb-76f980764c9c None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:33:25.812076 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2cbdf3-623e-451c-befb-76f980764c9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:33:25.831603 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.auth.core [None req-af2cbdf3-623e-451c-befb-76f980764c9c None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:33:25.832710 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.fernet_utils [None req-af2cbdf3-623e-451c-befb-76f980764c9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:33:25.840797 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 550/1100] 10.222.0.104 () {58 vars in 1029 bytes} [Tue Aug 9 16:33:25 2022] POST /identity/v3/auth/tokens => generated 2807 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 16:33:25.878298 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aade0057-5482-4981-ad03-94be317fccb4 None None] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:33:25.888924 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aade0057-5482-4981-ad03-94be317fccb4 None None] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:33:25.892367 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260e0a48-5150-4e6d-951e-75e3952b592e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da49ba8d1a21406eac55503b42fea65b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63557f0ff1ce4ae49899b4627bafd94e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:33:25.892977 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260e0a48-5150-4e6d-951e-75e3952b592e service neutron] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:33:25.893249 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260e0a48-5150-4e6d-951e-75e3952b592e service neutron] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:33:25.893511 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260e0a48-5150-4e6d-951e-75e3952b592e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:33:25.902229 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260e0a48-5150-4e6d-951e-75e3952b592e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:33:25.903638 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260e0a48-5150-4e6d-951e-75e3952b592e service neutron] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:33:25.912833 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 551/1101] 10.222.0.104 () {60 vars in 1370 bytes} [Tue Aug 9 16:33:25 2022] GET /identity/v3/auth/tokens => generated 2807 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 16:33:28.245958 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11d01f5-11ee-4eb4-98d6-215f8c4a5a2a None None] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:33:28.246494 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11d01f5-11ee-4eb4-98d6-215f8c4a5a2a None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:33:28.246494 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11d01f5-11ee-4eb4-98d6-215f8c4a5a2a None None] PATH_INFO: `/` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:33:28.247819 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 551/1102] 10.222.0.104 () {54 vars in 932 bytes} [Tue Aug 9 16:33:28 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:33:28.252873 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430c5e11-ca16-4ecb-af30-588c1dbe5ca3 None None] REQUEST_METHOD: `POST` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:33:28.253259 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430c5e11-ca16-4ecb-af30-588c1dbe5ca3 None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:33:28.253417 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430c5e11-ca16-4ecb-af30-588c1dbe5ca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:33:28.272341 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.auth.core [None req-430c5e11-ca16-4ecb-af30-588c1dbe5ca3 None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:33:28.273516 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.fernet_utils [None req-430c5e11-ca16-4ecb-af30-588c1dbe5ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:33:28.281911 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 552/1103] 10.222.0.104 () {58 vars in 1029 bytes} [Tue Aug 9 16:33:28 2022] POST /identity/v3/auth/tokens => generated 2807 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 16:33:28.321376 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11d01f5-11ee-4eb4-98d6-215f8c4a5a2a None None] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:33:28.332041 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11d01f5-11ee-4eb4-98d6-215f8c4a5a2a None None] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:33:28.335852 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0fabdb-6e13-4070-9feb-def7e318a01e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da49ba8d1a21406eac55503b42fea65b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63557f0ff1ce4ae49899b4627bafd94e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:33:28.336432 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0fabdb-6e13-4070-9feb-def7e318a01e service neutron] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:33:28.336702 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0fabdb-6e13-4070-9feb-def7e318a01e service neutron] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:33:28.336969 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0fabdb-6e13-4070-9feb-def7e318a01e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:33:28.347279 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0fabdb-6e13-4070-9feb-def7e318a01e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:33:28.348698 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0fabdb-6e13-4070-9feb-def7e318a01e service neutron] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:33:28.358420 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 552/1104] 10.222.0.104 () {60 vars in 1370 bytes} [Tue Aug 9 16:33:28 2022] GET /identity/v3/auth/tokens => generated 2807 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 16:33:30.844034 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a410ea-c300-42e9-8574-3b5a3c80db09 None None] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:33:30.844585 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a410ea-c300-42e9-8574-3b5a3c80db09 None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:33:30.844585 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a410ea-c300-42e9-8574-3b5a3c80db09 None None] PATH_INFO: `/` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:33:30.845892 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 553/1105] 10.222.0.104 () {54 vars in 932 bytes} [Tue Aug 9 16:33:30 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:33:30.851072 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d4cb3f-c91a-4fa7-af40-ede756f4f444 None None] REQUEST_METHOD: `POST` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:33:30.851455 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d4cb3f-c91a-4fa7-af40-ede756f4f444 None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:33:30.851612 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d4cb3f-c91a-4fa7-af40-ede756f4f444 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:33:30.870617 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.auth.core [None req-00d4cb3f-c91a-4fa7-af40-ede756f4f444 None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:33:30.871794 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.fernet_utils [None req-00d4cb3f-c91a-4fa7-af40-ede756f4f444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:33:30.879414 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 553/1106] 10.222.0.104 () {58 vars in 1029 bytes} [Tue Aug 9 16:33:30 2022] POST /identity/v3/auth/tokens => generated 2807 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 16:33:30.920668 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a410ea-c300-42e9-8574-3b5a3c80db09 None None] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:33:30.931295 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a410ea-c300-42e9-8574-3b5a3c80db09 None None] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:33:30.934826 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0587273-ded7-44ad-9bd8-bcd44c2db3f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da49ba8d1a21406eac55503b42fea65b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63557f0ff1ce4ae49899b4627bafd94e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:33:30.935408 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0587273-ded7-44ad-9bd8-bcd44c2db3f3 service neutron] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:33:30.935683 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0587273-ded7-44ad-9bd8-bcd44c2db3f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:33:30.935949 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0587273-ded7-44ad-9bd8-bcd44c2db3f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:33:30.944595 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0587273-ded7-44ad-9bd8-bcd44c2db3f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:33:30.946031 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0587273-ded7-44ad-9bd8-bcd44c2db3f3 service neutron] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:33:30.955227 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 554/1107] 10.222.0.104 () {60 vars in 1370 bytes} [Tue Aug 9 16:33:30 2022] GET /identity/v3/auth/tokens => generated 2807 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 16:33:33.409182 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53635557-2090-48b6-83dc-d3cd156e5b7a None None] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:33:33.409751 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53635557-2090-48b6-83dc-d3cd156e5b7a None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:33:33.409751 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53635557-2090-48b6-83dc-d3cd156e5b7a None None] PATH_INFO: `/` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:33:33.411073 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 554/1108] 10.222.0.104 () {54 vars in 932 bytes} [Tue Aug 9 16:33:33 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:33:33.416318 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc41b00-7ec3-4203-bbf8-1a014c4f3d73 None None] REQUEST_METHOD: `POST` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:33:33.416746 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc41b00-7ec3-4203-bbf8-1a014c4f3d73 None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:33:33.416866 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc41b00-7ec3-4203-bbf8-1a014c4f3d73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:33:33.436522 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.auth.core [None req-1dc41b00-7ec3-4203-bbf8-1a014c4f3d73 None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:33:33.437718 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.fernet_utils [None req-1dc41b00-7ec3-4203-bbf8-1a014c4f3d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:33:33.445397 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 555/1109] 10.222.0.104 () {58 vars in 1029 bytes} [Tue Aug 9 16:33:33 2022] POST /identity/v3/auth/tokens => generated 2807 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 16:33:33.488038 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53635557-2090-48b6-83dc-d3cd156e5b7a None None] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:33:33.499257 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53635557-2090-48b6-83dc-d3cd156e5b7a None None] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:33:33.502697 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c205fe2-39a7-4d70-bfad-6774df616d46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da49ba8d1a21406eac55503b42fea65b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63557f0ff1ce4ae49899b4627bafd94e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:33:33.503283 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c205fe2-39a7-4d70-bfad-6774df616d46 service neutron] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:33:33.503558 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c205fe2-39a7-4d70-bfad-6774df616d46 service neutron] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:33:33.503829 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c205fe2-39a7-4d70-bfad-6774df616d46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:33:33.512471 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c205fe2-39a7-4d70-bfad-6774df616d46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:33:33.513885 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c205fe2-39a7-4d70-bfad-6774df616d46 service neutron] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:33:33.522949 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 555/1110] 10.222.0.104 () {60 vars in 1370 bytes} [Tue Aug 9 16:33:33 2022] GET /identity/v3/auth/tokens => generated 2807 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 16:33:43.431366 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=33 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:33:43.518946 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=33 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:34:45.987473 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6c0661-e87c-4367-816a-e6a733d69496 None None] REQUEST_METHOD: `POST` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:34:45.988131 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6c0661-e87c-4367-816a-e6a733d69496 None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:34:45.988131 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6c0661-e87c-4367-816a-e6a733d69496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:34:46.008354 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.auth.core [None req-ca6c0661-e87c-4367-816a-e6a733d69496 None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:34:46.009575 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.fernet_utils [None req-ca6c0661-e87c-4367-816a-e6a733d69496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:34:46.018454 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 556/1111] 10.222.0.104 () {58 vars in 963 bytes} [Tue Aug 9 16:34:45 2022] POST /identity/v3/auth/tokens => generated 2807 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 16:34:46.026362 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3cf8fc-29ca-4c57-9ec0-d5a4f9ee7e14 None None] REQUEST_METHOD: `POST` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:34:46.026953 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3cf8fc-29ca-4c57-9ec0-d5a4f9ee7e14 None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:34:46.026953 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3cf8fc-29ca-4c57-9ec0-d5a4f9ee7e14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:34:46.046235 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.auth.core [None req-6a3cf8fc-29ca-4c57-9ec0-d5a4f9ee7e14 None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:34:46.047415 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.fernet_utils [None req-6a3cf8fc-29ca-4c57-9ec0-d5a4f9ee7e14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:34:46.055108 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 556/1112] 10.222.0.104 () {58 vars in 963 bytes} [Tue Aug 9 16:34:46 2022] POST /identity/v3/auth/tokens => generated 2807 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 16:34:46.059918 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6c0661-e87c-4367-816a-e6a733d69496 None None] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:34:46.069474 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6c0661-e87c-4367-816a-e6a733d69496 None None] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:34:46.074589 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d7ad7b-9b8b-4d16-9123-3c8a04914a9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce95c8faa1d4165b111ca9c55852804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:34:46.075181 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d7ad7b-9b8b-4d16-9123-3c8a04914a9d admin admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:34:46.075458 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d7ad7b-9b8b-4d16-9123-3c8a04914a9d admin admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:34:46.075729 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d7ad7b-9b8b-4d16-9123-3c8a04914a9d admin admin] PATH_INFO: `/v3/domains` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:34:46.076369 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d7ad7b-9b8b-4d16-9123-3c8a04914a9d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:34:46.076672 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d7ad7b-9b8b-4d16-9123-3c8a04914a9d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:34:46.077674 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: WARNING py.warnings [None req-05d7ad7b-9b8b-4d16-9123-3c8a04914a9d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 16:34:46.077674 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: warnings.warn(msg) Aug 09 16:34:46.077674 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: Aug 09 16:34:46.078884 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d7ad7b-9b8b-4d16-9123-3c8a04914a9d admin admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:34:46.090894 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 557/1113] 10.222.0.104 () {58 vars in 1158 bytes} [Tue Aug 9 16:34:46 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:34:46.098840 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3cf8fc-29ca-4c57-9ec0-d5a4f9ee7e14 None None] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:34:46.107799 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3cf8fc-29ca-4c57-9ec0-d5a4f9ee7e14 None None] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:34:46.112232 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbc395f-9ace-48d2-82b3-5ac769cb5a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce95c8faa1d4165b111ca9c55852804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:34:46.112816 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbc395f-9ace-48d2-82b3-5ac769cb5a92 admin admin] REQUEST_METHOD: `POST` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:34:46.113090 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbc395f-9ace-48d2-82b3-5ac769cb5a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:34:46.113356 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbc395f-9ace-48d2-82b3-5ac769cb5a92 admin admin] PATH_INFO: `/v3/projects` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:34:46.113996 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbc395f-9ace-48d2-82b3-5ac769cb5a92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:34:46.115755 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: WARNING py.warnings [None req-3fbc395f-9ace-48d2-82b3-5ac769cb5a92 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 09 16:34:46.115755 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: warnings.warn(msg) Aug 09 16:34:46.115755 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: Aug 09 16:34:46.116932 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbc395f-9ace-48d2-82b3-5ac769cb5a92 admin admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:34:46.145162 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 557/1114] 10.222.0.104 () {60 vars in 1158 bytes} [Tue Aug 9 16:34:46 2022] POST /identity/v3/projects => generated 378 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 16:34:46.149079 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d7ad7b-9b8b-4d16-9123-3c8a04914a9d admin admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:34:46.159681 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d7ad7b-9b8b-4d16-9123-3c8a04914a9d admin admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:34:46.215084 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5c85f5-f63f-4e1b-82c4-bcb52185404d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce95c8faa1d4165b111ca9c55852804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:34:46.215685 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5c85f5-f63f-4e1b-82c4-bcb52185404d admin admin] REQUEST_METHOD: `POST` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:34:46.215963 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5c85f5-f63f-4e1b-82c4-bcb52185404d admin admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:34:46.216234 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5c85f5-f63f-4e1b-82c4-bcb52185404d admin admin] PATH_INFO: `/v3/users` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:34:46.216860 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5c85f5-f63f-4e1b-82c4-bcb52185404d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:34:46.217870 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: WARNING py.warnings [None req-7f5c85f5-f63f-4e1b-82c4-bcb52185404d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 09 16:34:46.217870 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: warnings.warn(msg) Aug 09 16:34:46.217870 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: Aug 09 16:34:46.219093 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5c85f5-f63f-4e1b-82c4-bcb52185404d admin admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:34:46.240670 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 558/1115] 10.222.0.104 () {60 vars in 1149 bytes} [Tue Aug 9 16:34:46 2022] POST /identity/v3/users => generated 290 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 16:34:46.244732 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbc395f-9ace-48d2-82b3-5ac769cb5a92 admin admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:34:46.255376 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbc395f-9ace-48d2-82b3-5ac769cb5a92 admin admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:34:46.260032 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5061263e-d469-4f75-aad7-45b1695b2cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce95c8faa1d4165b111ca9c55852804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:34:46.260628 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5061263e-d469-4f75-aad7-45b1695b2cab admin admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:34:46.260906 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5061263e-d469-4f75-aad7-45b1695b2cab admin admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:34:46.261182 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5061263e-d469-4f75-aad7-45b1695b2cab admin admin] PATH_INFO: `/v3/roles` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:34:46.261815 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5061263e-d469-4f75-aad7-45b1695b2cab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:34:46.262862 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: WARNING py.warnings [None req-5061263e-d469-4f75-aad7-45b1695b2cab admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 16:34:46.262862 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: warnings.warn(msg) Aug 09 16:34:46.262862 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: Aug 09 16:34:46.264245 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5061263e-d469-4f75-aad7-45b1695b2cab admin admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:34:46.276661 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 558/1116] 10.222.0.104 () {58 vars in 1127 bytes} [Tue Aug 9 16:34:46 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 16:34:46.280470 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5c85f5-f63f-4e1b-82c4-bcb52185404d admin admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:34:46.290564 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5c85f5-f63f-4e1b-82c4-bcb52185404d admin admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:34:46.295927 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dccae1b-88b4-4f2e-816f-8006445385c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce95c8faa1d4165b111ca9c55852804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:34:46.296527 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dccae1b-88b4-4f2e-816f-8006445385c1 admin admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:34:46.296808 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dccae1b-88b4-4f2e-816f-8006445385c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:34:46.297082 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dccae1b-88b4-4f2e-816f-8006445385c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:34:46.297725 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dccae1b-88b4-4f2e-816f-8006445385c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:34:46.298774 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: WARNING py.warnings [None req-7dccae1b-88b4-4f2e-816f-8006445385c1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 16:34:46.298774 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: warnings.warn(msg) Aug 09 16:34:46.298774 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: Aug 09 16:34:46.299653 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dccae1b-88b4-4f2e-816f-8006445385c1 admin admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:34:46.313479 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 559/1117] 10.222.0.104 () {58 vars in 1127 bytes} [Tue Aug 9 16:34:46 2022] GET /identity/v3/roles => generated 1427 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 16:34:46.317716 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5061263e-d469-4f75-aad7-45b1695b2cab admin admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:34:46.327505 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5061263e-d469-4f75-aad7-45b1695b2cab admin admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:34:46.332039 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9e0cd9-9b2d-4eac-92d9-9910f4dd4ee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce95c8faa1d4165b111ca9c55852804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:34:46.332710 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9e0cd9-9b2d-4eac-92d9-9910f4dd4ee3 admin admin] REQUEST_METHOD: `PUT` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:34:46.332987 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9e0cd9-9b2d-4eac-92d9-9910f4dd4ee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:34:46.333259 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9e0cd9-9b2d-4eac-92d9-9910f4dd4ee3 admin admin] PATH_INFO: `/v3/projects/5b7ec8e1e6574fe7833db8c2c216c99a/users/452e0f28041b4bf0a3aab4e5a6271632/roles/044ca4f80141492b9c128ada543865e8` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:34:46.351491 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9e0cd9-9b2d-4eac-92d9-9910f4dd4ee3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b7ec8e1e6574fe7833db8c2c216c99a, user_id=452e0f28041b4bf0a3aab4e5a6271632, role_id=044ca4f80141492b9c128ada543865e8)` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:34:46.352604 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: WARNING py.warnings [None req-9f9e0cd9-9b2d-4eac-92d9-9910f4dd4ee3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 09 16:34:46.352604 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: warnings.warn(msg) Aug 09 16:34:46.352604 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: Aug 09 16:34:46.354590 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9e0cd9-9b2d-4eac-92d9-9910f4dd4ee3 admin admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:34:46.368207 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 559/1118] 10.222.0.104 () {60 vars in 1488 bytes} [Tue Aug 9 16:34:46 2022] PUT /identity/v3/projects/5b7ec8e1e6574fe7833db8c2c216c99a/users/452e0f28041b4bf0a3aab4e5a6271632/roles/044ca4f80141492b9c128ada543865e8 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 16:34:46.380372 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bc0e6e-f12f-4790-b4ac-58a280d87e76 None None] REQUEST_METHOD: `POST` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:34:46.380650 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bc0e6e-f12f-4790-b4ac-58a280d87e76 None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:34:46.380962 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bc0e6e-f12f-4790-b4ac-58a280d87e76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:34:46.410136 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.auth.core [None req-e5bc0e6e-f12f-4790-b4ac-58a280d87e76 None None] MFA Rules not processed for user `452e0f28041b4bf0a3aab4e5a6271632`. Rule list: `[]` (Enabled: `True`). {{(pid=87276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:34:46.411340 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.fernet_utils [None req-e5bc0e6e-f12f-4790-b4ac-58a280d87e76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:34:46.473669 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 560/1119] 10.222.0.104 () {58 vars in 963 bytes} [Tue Aug 9 16:34:46 2022] POST /identity/v3/auth/tokens => generated 2822 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 16:34:46.486619 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1599ac-f510-42e0-9698-2e714c6cfe63 None None] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:34:46.486899 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1599ac-f510-42e0-9698-2e714c6cfe63 None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:34:46.487169 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1599ac-f510-42e0-9698-2e714c6cfe63 None None] PATH_INFO: `/` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:34:46.488473 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 560/1120] 10.222.0.104 () {54 vars in 969 bytes} [Tue Aug 9 16:34:46 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:34:46.493375 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a80e4e-ca5e-45b6-bff6-0c2bd94921fc None None] REQUEST_METHOD: `POST` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:34:46.493598 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a80e4e-ca5e-45b6-bff6-0c2bd94921fc None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:34:46.493867 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a80e4e-ca5e-45b6-bff6-0c2bd94921fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:34:46.513658 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.auth.core [None req-e7a80e4e-ca5e-45b6-bff6-0c2bd94921fc None None] MFA Rules not processed for user `e914013dfd8b448e8cdbd6b8399cfd0c`. Rule list: `[]` (Enabled: `True`). {{(pid=87276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:34:46.514879 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.fernet_utils [None req-e7a80e4e-ca5e-45b6-bff6-0c2bd94921fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:34:46.556540 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:34:46.565028 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 561/1121] 10.222.0.104 () {58 vars in 1066 bytes} [Tue Aug 9 16:34:46 2022] POST /identity/v3/auth/tokens => generated 2688 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 16:34:46.572726 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1599ac-f510-42e0-9698-2e714c6cfe63 None None] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:34:46.583977 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1599ac-f510-42e0-9698-2e714c6cfe63 None None] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:34:46.587752 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e40624-f1cc-466f-9933-445dd476cb5a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e914013dfd8b448e8cdbd6b8399cfd0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63557f0ff1ce4ae49899b4627bafd94e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:34:46.588327 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e40624-f1cc-466f-9933-445dd476cb5a service cinder] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:34:46.588601 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e40624-f1cc-466f-9933-445dd476cb5a service cinder] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:34:46.588868 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e40624-f1cc-466f-9933-445dd476cb5a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:34:46.596794 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e40624-f1cc-466f-9933-445dd476cb5a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:34:46.598246 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e40624-f1cc-466f-9933-445dd476cb5a service cinder] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:34:46.606785 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 561/1122] 10.222.0.104 () {60 vars in 1370 bytes} [Tue Aug 9 16:34:46 2022] GET /identity/v3/auth/tokens => generated 2822 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 16:34:46.644523 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0dec65-7451-43b2-8d2a-4bdd3396b810 None None] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:34:46.644809 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0dec65-7451-43b2-8d2a-4bdd3396b810 None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:34:46.645080 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0dec65-7451-43b2-8d2a-4bdd3396b810 None None] PATH_INFO: `/` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:34:46.646366 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 562/1123] 10.222.0.104 () {52 vars in 835 bytes} [Tue Aug 9 16:34:46 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:34:46.650190 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e40624-f1cc-466f-9933-445dd476cb5a service cinder] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:34:46.714532 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e40624-f1cc-466f-9933-445dd476cb5a service cinder] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:34:46.719037 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc65639c-21f5-402f-a06f-6162a483f941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce95c8faa1d4165b111ca9c55852804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:34:46.719654 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc65639c-21f5-402f-a06f-6162a483f941 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:34:46.719927 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc65639c-21f5-402f-a06f-6162a483f941 admin admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:34:46.720195 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc65639c-21f5-402f-a06f-6162a483f941 admin admin] PATH_INFO: `/v3/users/452e0f28041b4bf0a3aab4e5a6271632` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:34:46.721312 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc65639c-21f5-402f-a06f-6162a483f941 admin admin] RBAC: Authorizing `identity:delete_user(user_id=452e0f28041b4bf0a3aab4e5a6271632)` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:34:46.722357 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: WARNING py.warnings [None req-bc65639c-21f5-402f-a06f-6162a483f941 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 09 16:34:46.722357 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: warnings.warn(msg) Aug 09 16:34:46.722357 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: Aug 09 16:34:46.723539 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc65639c-21f5-402f-a06f-6162a483f941 admin admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:34:46.796245 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.notifications [None req-bc65639c-21f5-402f-a06f-6162a483f941 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '452e0f28041b4bf0a3aab4e5a6271632'} {{(pid=87275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 16:34:46.810736 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.notifications [None req-bc65639c-21f5-402f-a06f-6162a483f941 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '452e0f28041b4bf0a3aab4e5a6271632'} {{(pid=87275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 16:34:46.820022 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.notifications [None req-bc65639c-21f5-402f-a06f-6162a483f941 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '452e0f28041b4bf0a3aab4e5a6271632'} {{(pid=87275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 16:34:46.820740 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.notifications [None req-bc65639c-21f5-402f-a06f-6162a483f941 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '452e0f28041b4bf0a3aab4e5a6271632'} {{(pid=87275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 16:34:46.846161 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.notifications [None req-bc65639c-21f5-402f-a06f-6162a483f941 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '452e0f28041b4bf0a3aab4e5a6271632'} {{(pid=87275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 16:34:46.852050 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 562/1124] 10.222.0.104 () {58 vars in 1229 bytes} [Tue Aug 9 16:34:46 2022] DELETE /identity/v3/users/452e0f28041b4bf0a3aab4e5a6271632 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 16:34:46.856528 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1600e060-c126-487f-8523-bbff981582f9 None None] REQUEST_METHOD: `POST` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:34:46.856813 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1600e060-c126-487f-8523-bbff981582f9 None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:34:46.857087 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1600e060-c126-487f-8523-bbff981582f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:34:46.875452 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.auth.core [None req-1600e060-c126-487f-8523-bbff981582f9 None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:34:46.876644 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.fernet_utils [None req-1600e060-c126-487f-8523-bbff981582f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:34:46.934350 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 563/1125] 10.222.0.104 () {58 vars in 963 bytes} [Tue Aug 9 16:34:46 2022] POST /identity/v3/auth/tokens => generated 2807 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 16:34:46.943717 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc65639c-21f5-402f-a06f-6162a483f941 admin admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:34:46.945434 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.fernet_utils [None req-bc65639c-21f5-402f-a06f-6162a483f941 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:34:46.951337 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:34:47.135711 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc65639c-21f5-402f-a06f-6162a483f941 admin admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:34:47.139739 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada0e9ca-fda8-421a-8657-c1ffe63a7c1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da49ba8d1a21406eac55503b42fea65b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63557f0ff1ce4ae49899b4627bafd94e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:34:47.140345 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada0e9ca-fda8-421a-8657-c1ffe63a7c1a service neutron] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:34:47.140623 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada0e9ca-fda8-421a-8657-c1ffe63a7c1a service neutron] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:34:47.140892 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada0e9ca-fda8-421a-8657-c1ffe63a7c1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:34:47.150027 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada0e9ca-fda8-421a-8657-c1ffe63a7c1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:34:47.151445 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada0e9ca-fda8-421a-8657-c1ffe63a7c1a service neutron] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:34:47.161407 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 563/1126] 10.222.0.104 () {60 vars in 1370 bytes} [Tue Aug 9 16:34:46 2022] GET /identity/v3/auth/tokens => generated 2807 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 16:34:47.519472 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1600e060-c126-487f-8523-bbff981582f9 None None] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:34:47.520939 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.fernet_utils [None req-1600e060-c126-487f-8523-bbff981582f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:34:47.533335 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1600e060-c126-487f-8523-bbff981582f9 None None] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:34:47.537869 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c907ebd-ef8a-4f2e-8b43-89d8e553a9b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce95c8faa1d4165b111ca9c55852804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:34:47.538546 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c907ebd-ef8a-4f2e-8b43-89d8e553a9b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:34:47.538823 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c907ebd-ef8a-4f2e-8b43-89d8e553a9b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:34:47.539093 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c907ebd-ef8a-4f2e-8b43-89d8e553a9b4 admin admin] PATH_INFO: `/v3/projects/5b7ec8e1e6574fe7833db8c2c216c99a` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:34:47.542239 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c907ebd-ef8a-4f2e-8b43-89d8e553a9b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b7ec8e1e6574fe7833db8c2c216c99a)` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:34:47.542239 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: WARNING py.warnings [None req-0c907ebd-ef8a-4f2e-8b43-89d8e553a9b4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 09 16:34:47.542239 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: warnings.warn(msg) Aug 09 16:34:47.542239 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: Aug 09 16:34:47.542586 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c907ebd-ef8a-4f2e-8b43-89d8e553a9b4 admin admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:34:47.609872 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.notifications [None req-0c907ebd-ef8a-4f2e-8b43-89d8e553a9b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b7ec8e1e6574fe7833db8c2c216c99a', 'request_id': 'req-0c907ebd-ef8a-4f2e-8b43-89d8e553a9b4'} {{(pid=87276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 16:34:47.615870 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.notifications [None req-0c907ebd-ef8a-4f2e-8b43-89d8e553a9b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b7ec8e1e6574fe7833db8c2c216c99a', 'request_id': 'req-0c907ebd-ef8a-4f2e-8b43-89d8e553a9b4'} {{(pid=87276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 16:34:47.625672 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.notifications [None req-0c907ebd-ef8a-4f2e-8b43-89d8e553a9b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b7ec8e1e6574fe7833db8c2c216c99a', 'request_id': 'req-0c907ebd-ef8a-4f2e-8b43-89d8e553a9b4'} {{(pid=87276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 16:34:47.644371 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.notifications [None req-0c907ebd-ef8a-4f2e-8b43-89d8e553a9b4 admin admin] The token cache is being invalidate because project 5b7ec8e1e6574fe7833db8c2c216c99a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87276) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 16:34:47.644659 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.notifications [None req-0c907ebd-ef8a-4f2e-8b43-89d8e553a9b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 16:34:47.645408 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.notifications [None req-0c907ebd-ef8a-4f2e-8b43-89d8e553a9b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 16:34:47.647024 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 564/1127] 10.222.0.104 () {58 vars in 1238 bytes} [Tue Aug 9 16:34:47 2022] DELETE /identity/v3/projects/5b7ec8e1e6574fe7833db8c2c216c99a => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 16:34:57.157264 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=25 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:34:57.641215 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:36:13.724447 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8956ee6e-7452-4402-b829-000655d0618f None None] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:36:13.724992 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8956ee6e-7452-4402-b829-000655d0618f None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:36:13.724992 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8956ee6e-7452-4402-b829-000655d0618f None None] PATH_INFO: `/` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:36:13.726360 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 564/1128] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 9 16:36:13 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:36:13.731144 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dbe637-d786-4c57-b260-211c26bed800 None None] REQUEST_METHOD: `POST` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:36:13.731578 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dbe637-d786-4c57-b260-211c26bed800 None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:36:13.731686 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dbe637-d786-4c57-b260-211c26bed800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:36:13.802030 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.auth.core [None req-22dbe637-d786-4c57-b260-211c26bed800 None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:36:13.803256 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.fernet_utils [None req-22dbe637-d786-4c57-b260-211c26bed800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:36:13.895867 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 565/1129] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 9 16:36:13 2022] POST /identity/v3/auth/tokens => generated 2807 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 16:36:14.063394 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8956ee6e-7452-4402-b829-000655d0618f None None] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:36:14.065097 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.fernet_utils [None req-8956ee6e-7452-4402-b829-000655d0618f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:36:14.154557 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8956ee6e-7452-4402-b829-000655d0618f None None] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:36:14.159405 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70116268-94b3-4df8-b9ac-f4ccdd4c42bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4c33c3fc318484d9cdfae778d23f06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63557f0ff1ce4ae49899b4627bafd94e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:36:14.160005 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70116268-94b3-4df8-b9ac-f4ccdd4c42bf service nova] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:36:14.160282 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70116268-94b3-4df8-b9ac-f4ccdd4c42bf service nova] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:36:14.160551 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70116268-94b3-4df8-b9ac-f4ccdd4c42bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:36:14.168398 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70116268-94b3-4df8-b9ac-f4ccdd4c42bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:36:14.170017 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70116268-94b3-4df8-b9ac-f4ccdd4c42bf service nova] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:36:14.179172 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 565/1130] 10.222.0.104 () {60 vars in 1370 bytes} [Tue Aug 9 16:36:14 2022] GET /identity/v3/auth/tokens => generated 2807 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 16:36:15.013276 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289f76ff-ddbf-4336-a018-8ac24bc18015 None None] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:36:15.013973 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289f76ff-ddbf-4336-a018-8ac24bc18015 None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:36:15.013973 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289f76ff-ddbf-4336-a018-8ac24bc18015 None None] PATH_INFO: `/` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:36:15.015160 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 566/1131] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 9 16:36:15 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:36:15.020168 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06476038-713f-43a8-9696-864e71e939d0 None None] REQUEST_METHOD: `POST` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:36:15.020561 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06476038-713f-43a8-9696-864e71e939d0 None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:36:15.020661 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06476038-713f-43a8-9696-864e71e939d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:36:15.039610 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.auth.core [None req-06476038-713f-43a8-9696-864e71e939d0 None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:36:15.040841 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.fernet_utils [None req-06476038-713f-43a8-9696-864e71e939d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:36:15.048744 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 566/1132] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 9 16:36:15 2022] POST /identity/v3/auth/tokens => generated 2807 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 16:36:15.203929 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289f76ff-ddbf-4336-a018-8ac24bc18015 None None] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:36:15.217502 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289f76ff-ddbf-4336-a018-8ac24bc18015 None None] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:36:15.222413 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a43d103-95b2-45d4-ba62-50ec30dd47db service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4c33c3fc318484d9cdfae778d23f06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63557f0ff1ce4ae49899b4627bafd94e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:36:15.222997 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a43d103-95b2-45d4-ba62-50ec30dd47db service nova] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:36:15.223273 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a43d103-95b2-45d4-ba62-50ec30dd47db service nova] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:36:15.223546 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a43d103-95b2-45d4-ba62-50ec30dd47db service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:36:15.231570 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a43d103-95b2-45d4-ba62-50ec30dd47db service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:36:15.233132 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a43d103-95b2-45d4-ba62-50ec30dd47db service nova] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:36:15.242342 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 567/1133] 10.222.0.104 () {60 vars in 1370 bytes} [Tue Aug 9 16:36:15 2022] GET /identity/v3/auth/tokens => generated 2807 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 16:36:20.706631 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222d8f55-5746-4a5e-a506-b4da1a6a74bf None None] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:36:20.707376 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222d8f55-5746-4a5e-a506-b4da1a6a74bf None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:36:20.707469 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222d8f55-5746-4a5e-a506-b4da1a6a74bf None None] PATH_INFO: `/v3` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:36:20.708668 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 567/1134] 10.222.0.121 () {54 vars in 930 bytes} [Tue Aug 9 16:36:20 2022] GET /identity/v3 => generated 256 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 16:36:20.715643 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7510fe-63db-4bdc-a989-a39f4ca6d8b5 None None] REQUEST_METHOD: `POST` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:36:20.716078 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7510fe-63db-4bdc-a989-a39f4ca6d8b5 None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:36:20.716175 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7510fe-63db-4bdc-a989-a39f4ca6d8b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:36:20.745434 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.auth.core [None req-9d7510fe-63db-4bdc-a989-a39f4ca6d8b5 None None] MFA Rules not processed for user `cfd1352d64de487ca4675cbe113e919f`. Rule list: `[]` (Enabled: `True`). {{(pid=87276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:36:20.746675 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.fernet_utils [None req-9d7510fe-63db-4bdc-a989-a39f4ca6d8b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:36:20.806831 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:36:20.816817 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 568/1135] 10.222.0.121 () {58 vars in 1020 bytes} [Tue Aug 9 16:36:20 2022] POST /identity/v3/auth/tokens => generated 2876 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 16:36:25.035008 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=42 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:36:25.173543 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869b514c-e065-441c-9189-599fd557b87e None None] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:36:25.173799 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869b514c-e065-441c-9189-599fd557b87e None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:36:25.174109 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869b514c-e065-441c-9189-599fd557b87e None None] PATH_INFO: `/` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:36:25.175632 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 568/1136] 10.222.0.104 () {54 vars in 966 bytes} [Tue Aug 9 16:36:25 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:36:25.181892 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc07ce4f-bd4e-4926-9e47-5205d7711556 None None] REQUEST_METHOD: `POST` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:36:25.182414 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc07ce4f-bd4e-4926-9e47-5205d7711556 None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:36:25.182513 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc07ce4f-bd4e-4926-9e47-5205d7711556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:36:25.201835 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.auth.core [None req-dc07ce4f-bd4e-4926-9e47-5205d7711556 None None] MFA Rules not processed for user `cfd1352d64de487ca4675cbe113e919f`. Rule list: `[]` (Enabled: `True`). {{(pid=87276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:36:25.203153 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.fernet_utils [None req-dc07ce4f-bd4e-4926-9e47-5205d7711556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:36:25.211928 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 569/1137] 10.222.0.104 () {58 vars in 1063 bytes} [Tue Aug 9 16:36:25 2022] POST /identity/v3/auth/tokens => generated 2876 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 16:36:25.220529 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869b514c-e065-441c-9189-599fd557b87e None None] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:36:25.233826 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869b514c-e065-441c-9189-599fd557b87e None None] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:36:25.238683 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1df311-c45e-49a7-8da7-df778d18aee5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfd1352d64de487ca4675cbe113e919f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63557f0ff1ce4ae49899b4627bafd94e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:36:25.239273 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1df311-c45e-49a7-8da7-df778d18aee5 service placement] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:36:25.239531 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1df311-c45e-49a7-8da7-df778d18aee5 service placement] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:36:25.239797 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1df311-c45e-49a7-8da7-df778d18aee5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:36:25.248318 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1df311-c45e-49a7-8da7-df778d18aee5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:36:25.249880 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1df311-c45e-49a7-8da7-df778d18aee5 service placement] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:36:25.259357 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 569/1138] 10.222.0.104 () {60 vars in 1370 bytes} [Tue Aug 9 16:36:25 2022] GET /identity/v3/auth/tokens => generated 2876 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 16:36:26.500383 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c80cbf-77a6-460e-8354-852c9b5b473e None None] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:36:26.500971 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c80cbf-77a6-460e-8354-852c9b5b473e None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:36:26.500971 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c80cbf-77a6-460e-8354-852c9b5b473e None None] PATH_INFO: `/` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:36:26.502431 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 570/1139] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 9 16:36:26 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:36:26.507440 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2c6151-5f47-4178-a075-71f35c1439ec None None] REQUEST_METHOD: `POST` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:36:26.507852 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2c6151-5f47-4178-a075-71f35c1439ec None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:36:26.507983 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2c6151-5f47-4178-a075-71f35c1439ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:36:26.527908 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.auth.core [None req-cd2c6151-5f47-4178-a075-71f35c1439ec None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:36:26.529107 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.fernet_utils [None req-cd2c6151-5f47-4178-a075-71f35c1439ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:36:26.538925 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 570/1140] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 9 16:36:26 2022] POST /identity/v3/auth/tokens => generated 2807 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 16:36:26.699793 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c80cbf-77a6-460e-8354-852c9b5b473e None None] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:36:26.713630 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c80cbf-77a6-460e-8354-852c9b5b473e None None] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:36:26.718589 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f60b41f-9bee-419d-8f12-f95c0e2c0569 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4c33c3fc318484d9cdfae778d23f06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63557f0ff1ce4ae49899b4627bafd94e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:36:26.719177 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f60b41f-9bee-419d-8f12-f95c0e2c0569 service nova] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:36:26.719450 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f60b41f-9bee-419d-8f12-f95c0e2c0569 service nova] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:36:26.719717 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f60b41f-9bee-419d-8f12-f95c0e2c0569 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:36:26.727666 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f60b41f-9bee-419d-8f12-f95c0e2c0569 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:36:26.729747 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f60b41f-9bee-419d-8f12-f95c0e2c0569 service nova] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:36:26.738941 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 571/1141] 10.222.0.104 () {60 vars in 1370 bytes} [Tue Aug 9 16:36:26 2022] GET /identity/v3/auth/tokens => generated 2807 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 16:36:27.559784 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f375f118-7465-4cf5-b911-177503d4c07b None None] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:36:27.560346 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f375f118-7465-4cf5-b911-177503d4c07b None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:36:27.560346 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f375f118-7465-4cf5-b911-177503d4c07b None None] PATH_INFO: `/` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:36:27.561684 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 571/1142] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 9 16:36:27 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:36:27.566362 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e910cb76-178f-4e63-abfe-c6e905b90fc9 None None] REQUEST_METHOD: `POST` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:36:27.566813 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e910cb76-178f-4e63-abfe-c6e905b90fc9 None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:36:27.566996 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e910cb76-178f-4e63-abfe-c6e905b90fc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:36:27.586606 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.auth.core [None req-e910cb76-178f-4e63-abfe-c6e905b90fc9 None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:36:27.588395 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.fernet_utils [None req-e910cb76-178f-4e63-abfe-c6e905b90fc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:36:27.596088 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 572/1143] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 9 16:36:27 2022] POST /identity/v3/auth/tokens => generated 2807 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 16:36:27.750123 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f375f118-7465-4cf5-b911-177503d4c07b None None] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:36:27.764140 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f375f118-7465-4cf5-b911-177503d4c07b None None] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:36:27.772215 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce549bb2-f2a0-46bf-b4a1-45eabe4c361f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4c33c3fc318484d9cdfae778d23f06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63557f0ff1ce4ae49899b4627bafd94e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:36:27.772821 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce549bb2-f2a0-46bf-b4a1-45eabe4c361f service nova] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:36:27.773097 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce549bb2-f2a0-46bf-b4a1-45eabe4c361f service nova] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:36:27.773365 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce549bb2-f2a0-46bf-b4a1-45eabe4c361f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:36:27.782817 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce549bb2-f2a0-46bf-b4a1-45eabe4c361f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:36:27.784481 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce549bb2-f2a0-46bf-b4a1-45eabe4c361f service nova] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:36:27.794369 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 572/1144] 10.222.0.104 () {60 vars in 1370 bytes} [Tue Aug 9 16:36:27 2022] GET /identity/v3/auth/tokens => generated 2807 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 16:36:31.969239 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879187d4-dc56-4bf6-83d1-43432bb7a158 None None] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:36:31.969800 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879187d4-dc56-4bf6-83d1-43432bb7a158 None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:36:31.969800 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879187d4-dc56-4bf6-83d1-43432bb7a158 None None] PATH_INFO: `/` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:36:31.971059 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 573/1145] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 9 16:36:31 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:36:31.976365 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37924b3f-bb78-4189-9fd7-e0061f59342f None None] REQUEST_METHOD: `POST` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:36:31.976832 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37924b3f-bb78-4189-9fd7-e0061f59342f None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:36:31.976935 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37924b3f-bb78-4189-9fd7-e0061f59342f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:36:31.995790 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.auth.core [None req-37924b3f-bb78-4189-9fd7-e0061f59342f None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:36:31.996981 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.fernet_utils [None req-37924b3f-bb78-4189-9fd7-e0061f59342f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:36:32.004839 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 573/1146] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 9 16:36:31 2022] POST /identity/v3/auth/tokens => generated 2807 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 16:36:32.042450 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879187d4-dc56-4bf6-83d1-43432bb7a158 None None] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:36:32.044174 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.fernet_utils [None req-879187d4-dc56-4bf6-83d1-43432bb7a158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:36:32.100609 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879187d4-dc56-4bf6-83d1-43432bb7a158 None None] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:36:32.104851 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5882d52-84f2-4b6c-9639-9794c5987c7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da49ba8d1a21406eac55503b42fea65b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63557f0ff1ce4ae49899b4627bafd94e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:36:32.105456 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5882d52-84f2-4b6c-9639-9794c5987c7a service neutron] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:36:32.105730 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5882d52-84f2-4b6c-9639-9794c5987c7a service neutron] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:36:32.106029 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5882d52-84f2-4b6c-9639-9794c5987c7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:36:32.114919 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5882d52-84f2-4b6c-9639-9794c5987c7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:36:32.116333 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5882d52-84f2-4b6c-9639-9794c5987c7a service neutron] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:36:32.126038 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 574/1147] 10.222.0.104 () {60 vars in 1370 bytes} [Tue Aug 9 16:36:32 2022] GET /identity/v3/auth/tokens => generated 2807 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 16:36:34.404065 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fa8982-2c55-4284-9ac3-ffbb6d41b01d None None] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:36:34.404632 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fa8982-2c55-4284-9ac3-ffbb6d41b01d None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:36:34.404632 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fa8982-2c55-4284-9ac3-ffbb6d41b01d None None] PATH_INFO: `/` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:36:34.405973 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 574/1148] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 9 16:36:34 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:36:34.411400 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e691e03-8e31-4a27-9eb3-a4e469a9949f None None] REQUEST_METHOD: `POST` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:36:34.411831 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e691e03-8e31-4a27-9eb3-a4e469a9949f None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:36:34.411831 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e691e03-8e31-4a27-9eb3-a4e469a9949f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:36:34.431479 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.auth.core [None req-9e691e03-8e31-4a27-9eb3-a4e469a9949f None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:36:34.432691 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.fernet_utils [None req-9e691e03-8e31-4a27-9eb3-a4e469a9949f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:36:34.440367 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 575/1149] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 9 16:36:34 2022] POST /identity/v3/auth/tokens => generated 2807 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 16:36:34.477462 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fa8982-2c55-4284-9ac3-ffbb6d41b01d None None] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:36:34.487985 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fa8982-2c55-4284-9ac3-ffbb6d41b01d None None] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:36:34.491544 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf1ee05-9c73-4e70-a97d-a9e267b7dd4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da49ba8d1a21406eac55503b42fea65b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63557f0ff1ce4ae49899b4627bafd94e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:36:34.492126 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf1ee05-9c73-4e70-a97d-a9e267b7dd4d service neutron] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:36:34.492400 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf1ee05-9c73-4e70-a97d-a9e267b7dd4d service neutron] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:36:34.492668 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf1ee05-9c73-4e70-a97d-a9e267b7dd4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:36:34.501789 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf1ee05-9c73-4e70-a97d-a9e267b7dd4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:36:34.503320 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf1ee05-9c73-4e70-a97d-a9e267b7dd4d service neutron] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:36:34.513080 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 575/1150] 10.222.0.104 () {60 vars in 1370 bytes} [Tue Aug 9 16:36:34 2022] GET /identity/v3/auth/tokens => generated 2807 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 16:36:38.370512 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848a3daf-0a3e-4bd7-84a3-59fd26ae3110 None None] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:36:38.371098 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848a3daf-0a3e-4bd7-84a3-59fd26ae3110 None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:36:38.371098 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848a3daf-0a3e-4bd7-84a3-59fd26ae3110 None None] PATH_INFO: `/` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:36:38.372413 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 576/1151] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 9 16:36:38 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:36:38.377698 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e9e732-5616-4414-97e9-b94662561360 None None] REQUEST_METHOD: `POST` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:36:38.378109 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e9e732-5616-4414-97e9-b94662561360 None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:36:38.378297 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e9e732-5616-4414-97e9-b94662561360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:36:38.397699 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.auth.core [None req-35e9e732-5616-4414-97e9-b94662561360 None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:36:38.398927 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.fernet_utils [None req-35e9e732-5616-4414-97e9-b94662561360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:36:38.406627 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 576/1152] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 9 16:36:38 2022] POST /identity/v3/auth/tokens => generated 2807 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 16:36:38.680106 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848a3daf-0a3e-4bd7-84a3-59fd26ae3110 None None] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:36:38.681765 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.fernet_utils [None req-848a3daf-0a3e-4bd7-84a3-59fd26ae3110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:36:38.738429 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848a3daf-0a3e-4bd7-84a3-59fd26ae3110 None None] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:36:38.741872 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a82e918-cde7-4054-bbe4-06b7df2ef833 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e914013dfd8b448e8cdbd6b8399cfd0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63557f0ff1ce4ae49899b4627bafd94e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:36:38.742494 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a82e918-cde7-4054-bbe4-06b7df2ef833 service cinder] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:36:38.742770 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a82e918-cde7-4054-bbe4-06b7df2ef833 service cinder] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:36:38.743455 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a82e918-cde7-4054-bbe4-06b7df2ef833 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:36:38.751981 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a82e918-cde7-4054-bbe4-06b7df2ef833 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:36:38.753398 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a82e918-cde7-4054-bbe4-06b7df2ef833 service cinder] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:36:38.763089 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 577/1153] 10.222.0.104 () {60 vars in 1370 bytes} [Tue Aug 9 16:36:38 2022] GET /identity/v3/auth/tokens => generated 2807 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 16:36:41.043522 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b9495d-b9d8-42d5-9d9d-b188ef15a646 None None] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:36:41.044081 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b9495d-b9d8-42d5-9d9d-b188ef15a646 None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:36:41.044081 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b9495d-b9d8-42d5-9d9d-b188ef15a646 None None] PATH_INFO: `/` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:36:41.045320 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 577/1154] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 9 16:36:41 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:36:41.050777 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aa753d-3243-418e-8d7e-954718b1c4e5 None None] REQUEST_METHOD: `POST` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:36:41.051236 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aa753d-3243-418e-8d7e-954718b1c4e5 None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:36:41.051342 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aa753d-3243-418e-8d7e-954718b1c4e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:36:41.072096 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.auth.core [None req-b2aa753d-3243-418e-8d7e-954718b1c4e5 None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:36:41.073295 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.fernet_utils [None req-b2aa753d-3243-418e-8d7e-954718b1c4e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:36:41.081074 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 578/1155] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 9 16:36:41 2022] POST /identity/v3/auth/tokens => generated 2807 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 16:36:41.369258 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b9495d-b9d8-42d5-9d9d-b188ef15a646 None None] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:36:41.371346 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.fernet_utils [None req-e0b9495d-b9d8-42d5-9d9d-b188ef15a646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:36:41.387480 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b9495d-b9d8-42d5-9d9d-b188ef15a646 None None] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:36:41.391034 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b58b7ea-72e2-42ae-827e-a22ed45cb8de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e914013dfd8b448e8cdbd6b8399cfd0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63557f0ff1ce4ae49899b4627bafd94e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:36:41.391630 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b58b7ea-72e2-42ae-827e-a22ed45cb8de service cinder] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:36:41.391902 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b58b7ea-72e2-42ae-827e-a22ed45cb8de service cinder] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:36:41.392170 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b58b7ea-72e2-42ae-827e-a22ed45cb8de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:36:41.402046 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b58b7ea-72e2-42ae-827e-a22ed45cb8de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:36:41.403537 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b58b7ea-72e2-42ae-827e-a22ed45cb8de service cinder] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:36:41.412954 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 578/1156] 10.222.0.104 () {60 vars in 1370 bytes} [Tue Aug 9 16:36:41 2022] GET /identity/v3/auth/tokens => generated 2807 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 16:36:51.065187 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=70 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:36:51.408896 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=33 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:37:56.296694 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a944c3-e31b-44ad-8f5e-26182a7f7878 None None] REQUEST_METHOD: `POST` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:37:56.297428 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a944c3-e31b-44ad-8f5e-26182a7f7878 None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:37:56.297428 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a944c3-e31b-44ad-8f5e-26182a7f7878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:37:56.313515 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c040974e-5e1a-48aa-b045-d5e53dd3f7d8 None None] REQUEST_METHOD: `POST` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:37:56.314159 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c040974e-5e1a-48aa-b045-d5e53dd3f7d8 None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:37:56.314159 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c040974e-5e1a-48aa-b045-d5e53dd3f7d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:37:56.335507 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.auth.core [None req-c040974e-5e1a-48aa-b045-d5e53dd3f7d8 None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:37:56.336778 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.fernet_utils [None req-c040974e-5e1a-48aa-b045-d5e53dd3f7d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:37:56.344902 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 579/1157] 10.222.0.104 () {58 vars in 963 bytes} [Tue Aug 9 16:37:56 2022] POST /identity/v3/auth/tokens => generated 2807 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 16:37:56.353624 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c50bf5-064f-494c-96a9-6a0553bc27ca None None] REQUEST_METHOD: `POST` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:37:56.353930 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c50bf5-064f-494c-96a9-6a0553bc27ca None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:37:56.354198 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c50bf5-064f-494c-96a9-6a0553bc27ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:37:56.376111 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.auth.core [None req-b1c50bf5-064f-494c-96a9-6a0553bc27ca None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:37:56.377351 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.fernet_utils [None req-b1c50bf5-064f-494c-96a9-6a0553bc27ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:37:56.385868 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 580/1158] 10.222.0.104 () {58 vars in 963 bytes} [Tue Aug 9 16:37:56 2022] POST /identity/v3/auth/tokens => generated 2807 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 16:37:56.390862 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c50bf5-064f-494c-96a9-6a0553bc27ca None None] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:37:56.400737 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c50bf5-064f-494c-96a9-6a0553bc27ca None None] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:37:56.407327 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bee3abc-3189-4178-8cc2-918bcee30b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce95c8faa1d4165b111ca9c55852804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:37:56.408013 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bee3abc-3189-4178-8cc2-918bcee30b97 admin admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:37:56.408447 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bee3abc-3189-4178-8cc2-918bcee30b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:37:56.408770 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bee3abc-3189-4178-8cc2-918bcee30b97 admin admin] PATH_INFO: `/v3/domains` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:37:56.409472 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bee3abc-3189-4178-8cc2-918bcee30b97 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87275) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:37:56.409847 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bee3abc-3189-4178-8cc2-918bcee30b97 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:37:56.411119 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: WARNING py.warnings [None req-2bee3abc-3189-4178-8cc2-918bcee30b97 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 16:37:56.411119 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: warnings.warn(msg) Aug 09 16:37:56.411119 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: Aug 09 16:37:56.412008 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bee3abc-3189-4178-8cc2-918bcee30b97 admin admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:37:56.425000 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 581/1159] 10.222.0.104 () {58 vars in 1158 bytes} [Tue Aug 9 16:37:56 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 16:37:56.433798 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bee3abc-3189-4178-8cc2-918bcee30b97 admin admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:37:56.444685 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bee3abc-3189-4178-8cc2-918bcee30b97 admin admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:37:56.445410 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.auth.core [None req-b1a944c3-e31b-44ad-8f5e-26182a7f7878 None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:37:56.446698 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.fernet_utils [None req-b1a944c3-e31b-44ad-8f5e-26182a7f7878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:37:56.449263 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8b1362-ca6e-4e5c-acd8-1617663fa16b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce95c8faa1d4165b111ca9c55852804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:37:56.449862 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8b1362-ca6e-4e5c-acd8-1617663fa16b admin admin] REQUEST_METHOD: `POST` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:37:56.450181 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8b1362-ca6e-4e5c-acd8-1617663fa16b admin admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:37:56.450455 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8b1362-ca6e-4e5c-acd8-1617663fa16b admin admin] PATH_INFO: `/v3/projects` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:37:56.451071 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8b1362-ca6e-4e5c-acd8-1617663fa16b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:37:56.452949 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8b1362-ca6e-4e5c-acd8-1617663fa16b admin admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:37:56.455305 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 579/1160] 10.222.0.104 () {58 vars in 963 bytes} [Tue Aug 9 16:37:56 2022] POST /identity/v3/auth/tokens => generated 2807 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 16:37:56.463342 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0030599-c5fe-4aa6-9570-c83d76264687 None None] REQUEST_METHOD: `POST` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:37:56.463627 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0030599-c5fe-4aa6-9570-c83d76264687 None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:37:56.463901 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0030599-c5fe-4aa6-9570-c83d76264687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:37:56.483021 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.auth.core [None req-e0030599-c5fe-4aa6-9570-c83d76264687 None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:37:56.484230 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.fernet_utils [None req-e0030599-c5fe-4aa6-9570-c83d76264687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:37:56.491142 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 582/1161] 10.222.0.104 () {60 vars in 1158 bytes} [Tue Aug 9 16:37:56 2022] POST /identity/v3/projects => generated 380 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 16:37:56.492683 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 580/1162] 10.222.0.104 () {58 vars in 963 bytes} [Tue Aug 9 16:37:56 2022] POST /identity/v3/auth/tokens => generated 2807 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 16:37:56.495150 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8b1362-ca6e-4e5c-acd8-1617663fa16b admin admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:37:56.496980 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0030599-c5fe-4aa6-9570-c83d76264687 None None] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:37:56.505750 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0030599-c5fe-4aa6-9570-c83d76264687 None None] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:37:56.556914 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8b1362-ca6e-4e5c-acd8-1617663fa16b admin admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:37:56.560594 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3950337-0ab0-423a-920a-408e3a6a0164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce95c8faa1d4165b111ca9c55852804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:37:56.561216 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3950337-0ab0-423a-920a-408e3a6a0164 admin admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:37:56.561492 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3950337-0ab0-423a-920a-408e3a6a0164 admin admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:37:56.561614 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a4fa43-9b31-409a-9278-c133f743b626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce95c8faa1d4165b111ca9c55852804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:37:56.561745 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3950337-0ab0-423a-920a-408e3a6a0164 admin admin] PATH_INFO: `/v3/domains` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:37:56.562111 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a4fa43-9b31-409a-9278-c133f743b626 admin admin] REQUEST_METHOD: `POST` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:37:56.562387 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a4fa43-9b31-409a-9278-c133f743b626 admin admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:37:56.562505 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3950337-0ab0-423a-920a-408e3a6a0164 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87276) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 16:37:56.562658 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a4fa43-9b31-409a-9278-c133f743b626 admin admin] PATH_INFO: `/v3/users` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:37:56.562795 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3950337-0ab0-423a-920a-408e3a6a0164 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:37:56.563275 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a4fa43-9b31-409a-9278-c133f743b626 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:37:56.564281 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: WARNING py.warnings [None req-68a4fa43-9b31-409a-9278-c133f743b626 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 09 16:37:56.564281 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: warnings.warn(msg) Aug 09 16:37:56.564281 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: Aug 09 16:37:56.564536 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3950337-0ab0-423a-920a-408e3a6a0164 admin admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:37:56.565459 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a4fa43-9b31-409a-9278-c133f743b626 admin admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:37:56.575998 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 581/1163] 10.222.0.104 () {58 vars in 1158 bytes} [Tue Aug 9 16:37:56 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 16:37:56.584839 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3950337-0ab0-423a-920a-408e3a6a0164 admin admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:37:56.590470 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 583/1164] 10.222.0.104 () {60 vars in 1149 bytes} [Tue Aug 9 16:37:56 2022] POST /identity/v3/users => generated 291 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 16:37:56.591554 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a4fa43-9b31-409a-9278-c133f743b626 admin admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:37:56.595137 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3950337-0ab0-423a-920a-408e3a6a0164 admin admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:37:56.600710 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db98cd3-c787-407b-a8bf-a43b1ea0e4a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce95c8faa1d4165b111ca9c55852804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:37:56.601298 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db98cd3-c787-407b-a8bf-a43b1ea0e4a3 admin admin] REQUEST_METHOD: `POST` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:37:56.601453 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a4fa43-9b31-409a-9278-c133f743b626 admin admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:37:56.601580 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db98cd3-c787-407b-a8bf-a43b1ea0e4a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:37:56.601819 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db98cd3-c787-407b-a8bf-a43b1ea0e4a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:37:56.602463 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db98cd3-c787-407b-a8bf-a43b1ea0e4a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:37:56.603465 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: WARNING py.warnings [None req-9db98cd3-c787-407b-a8bf-a43b1ea0e4a3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 09 16:37:56.603465 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: warnings.warn(msg) Aug 09 16:37:56.603465 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: Aug 09 16:37:56.604627 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db98cd3-c787-407b-a8bf-a43b1ea0e4a3 admin admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:37:56.606105 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbb7584-f271-40f2-b008-6ef1bbf7effd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce95c8faa1d4165b111ca9c55852804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:37:56.606687 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbb7584-f271-40f2-b008-6ef1bbf7effd admin admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:37:56.606966 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbb7584-f271-40f2-b008-6ef1bbf7effd admin admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:37:56.607239 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbb7584-f271-40f2-b008-6ef1bbf7effd admin admin] PATH_INFO: `/v3/roles` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:37:56.607867 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbb7584-f271-40f2-b008-6ef1bbf7effd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:37:56.609440 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbb7584-f271-40f2-b008-6ef1bbf7effd admin admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:37:56.619989 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 584/1165] 10.222.0.104 () {58 vars in 1127 bytes} [Tue Aug 9 16:37:56 2022] GET /identity/v3/roles => generated 1427 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 16:37:56.624255 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbb7584-f271-40f2-b008-6ef1bbf7effd admin admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:37:56.634321 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbb7584-f271-40f2-b008-6ef1bbf7effd admin admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:37:56.638972 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7684303f-0a2d-420b-836d-f365d9bcbba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce95c8faa1d4165b111ca9c55852804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:37:56.639563 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7684303f-0a2d-420b-836d-f365d9bcbba2 admin admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:37:56.639672 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 582/1166] 10.222.0.104 () {60 vars in 1158 bytes} [Tue Aug 9 16:37:56 2022] POST /identity/v3/projects => generated 386 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 16:37:56.639845 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7684303f-0a2d-420b-836d-f365d9bcbba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:37:56.640113 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7684303f-0a2d-420b-836d-f365d9bcbba2 admin admin] PATH_INFO: `/v3/roles` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:37:56.640744 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7684303f-0a2d-420b-836d-f365d9bcbba2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:37:56.642363 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7684303f-0a2d-420b-836d-f365d9bcbba2 admin admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:37:56.643713 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db98cd3-c787-407b-a8bf-a43b1ea0e4a3 admin admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:37:56.654534 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 585/1167] 10.222.0.104 () {58 vars in 1127 bytes} [Tue Aug 9 16:37:56 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 16:37:56.658721 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7684303f-0a2d-420b-836d-f365d9bcbba2 admin admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:37:56.669385 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7684303f-0a2d-420b-836d-f365d9bcbba2 admin admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:37:56.708544 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db98cd3-c787-407b-a8bf-a43b1ea0e4a3 admin admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:37:56.713999 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776b2218-b97a-430c-b744-a75cbd09cc3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce95c8faa1d4165b111ca9c55852804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:37:56.714623 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776b2218-b97a-430c-b744-a75cbd09cc3f admin admin] REQUEST_METHOD: `POST` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:37:56.714892 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776b2218-b97a-430c-b744-a75cbd09cc3f admin admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:37:56.715162 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776b2218-b97a-430c-b744-a75cbd09cc3f admin admin] PATH_INFO: `/v3/users` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:37:56.715778 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776b2218-b97a-430c-b744-a75cbd09cc3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:37:56.717789 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776b2218-b97a-430c-b744-a75cbd09cc3f admin admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:37:56.731051 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaebc7dd-c4b2-48f6-a19e-5a64f94cbe41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce95c8faa1d4165b111ca9c55852804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:37:56.731762 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaebc7dd-c4b2-48f6-a19e-5a64f94cbe41 admin admin] REQUEST_METHOD: `PUT` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:37:56.732030 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaebc7dd-c4b2-48f6-a19e-5a64f94cbe41 admin admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:37:56.732304 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaebc7dd-c4b2-48f6-a19e-5a64f94cbe41 admin admin] PATH_INFO: `/v3/projects/aeb10702851248c4a4ae6cf657bebbf3/users/b703ae8427a04f4f93b59e3df51cd312/roles/044ca4f80141492b9c128ada543865e8` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:37:56.742354 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 583/1168] 10.222.0.104 () {60 vars in 1149 bytes} [Tue Aug 9 16:37:56 2022] POST /identity/v3/users => generated 294 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 16:37:56.746333 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776b2218-b97a-430c-b744-a75cbd09cc3f admin admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:37:56.748393 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaebc7dd-c4b2-48f6-a19e-5a64f94cbe41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aeb10702851248c4a4ae6cf657bebbf3, user_id=b703ae8427a04f4f93b59e3df51cd312, role_id=044ca4f80141492b9c128ada543865e8)` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:37:56.751079 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaebc7dd-c4b2-48f6-a19e-5a64f94cbe41 admin admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:37:56.753376 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:37:56.756450 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776b2218-b97a-430c-b744-a75cbd09cc3f admin admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:37:56.761623 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04282f69-1125-48bd-9897-9e1f878c4beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce95c8faa1d4165b111ca9c55852804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:37:56.762276 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04282f69-1125-48bd-9897-9e1f878c4beb admin admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:37:56.762531 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04282f69-1125-48bd-9897-9e1f878c4beb admin admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:37:56.762962 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04282f69-1125-48bd-9897-9e1f878c4beb admin admin] PATH_INFO: `/v3/roles` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:37:56.763524 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04282f69-1125-48bd-9897-9e1f878c4beb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:37:56.765091 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04282f69-1125-48bd-9897-9e1f878c4beb admin admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:37:56.768680 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 586/1169] 10.222.0.104 () {60 vars in 1488 bytes} [Tue Aug 9 16:37:56 2022] PUT /identity/v3/projects/aeb10702851248c4a4ae6cf657bebbf3/users/b703ae8427a04f4f93b59e3df51cd312/roles/044ca4f80141492b9c128ada543865e8 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 16:37:56.773420 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5398ee-5133-4554-bbae-04a27d96a011 None None] REQUEST_METHOD: `POST` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:37:56.773699 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5398ee-5133-4554-bbae-04a27d96a011 None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:37:56.774003 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5398ee-5133-4554-bbae-04a27d96a011 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:37:56.781335 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 584/1170] 10.222.0.104 () {58 vars in 1127 bytes} [Tue Aug 9 16:37:56 2022] GET /identity/v3/roles => generated 1427 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 16:37:56.783319 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04282f69-1125-48bd-9897-9e1f878c4beb admin admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:37:56.792937 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.auth.core [None req-3d5398ee-5133-4554-bbae-04a27d96a011 None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:37:56.793221 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04282f69-1125-48bd-9897-9e1f878c4beb admin admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:37:56.794309 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.fernet_utils [None req-3d5398ee-5133-4554-bbae-04a27d96a011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:37:56.826740 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:37:56.852241 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4537697-5dac-47df-8c8a-5697b49de94c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce95c8faa1d4165b111ca9c55852804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:37:56.852847 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4537697-5dac-47df-8c8a-5697b49de94c admin admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:37:56.853120 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4537697-5dac-47df-8c8a-5697b49de94c admin admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:37:56.853386 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4537697-5dac-47df-8c8a-5697b49de94c admin admin] PATH_INFO: `/v3/roles` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:37:56.854077 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4537697-5dac-47df-8c8a-5697b49de94c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:37:56.855643 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4537697-5dac-47df-8c8a-5697b49de94c admin admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:37:56.856184 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 587/1171] 10.222.0.104 () {58 vars in 963 bytes} [Tue Aug 9 16:37:56 2022] POST /identity/v3/auth/tokens => generated 2807 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 16:37:56.866021 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5398ee-5133-4554-bbae-04a27d96a011 None None] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:37:56.871227 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 585/1172] 10.222.0.104 () {58 vars in 1127 bytes} [Tue Aug 9 16:37:56 2022] GET /identity/v3/roles => generated 1427 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 16:37:56.872353 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4537697-5dac-47df-8c8a-5697b49de94c admin admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:37:56.881818 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4537697-5dac-47df-8c8a-5697b49de94c admin admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:37:56.886854 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ac06e9-316c-4356-abec-eb29ebb899d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce95c8faa1d4165b111ca9c55852804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:37:56.887480 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ac06e9-316c-4356-abec-eb29ebb899d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:37:56.887903 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ac06e9-316c-4356-abec-eb29ebb899d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:37:56.888174 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ac06e9-316c-4356-abec-eb29ebb899d3 admin admin] PATH_INFO: `/v3/projects/c8bd20b38bda4c779d47edbdcc78ab5f/users/6f9a5f7afefa46b297c30ee8130d2c48/roles/044ca4f80141492b9c128ada543865e8` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:37:56.902966 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ac06e9-316c-4356-abec-eb29ebb899d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8bd20b38bda4c779d47edbdcc78ab5f, user_id=6f9a5f7afefa46b297c30ee8130d2c48, role_id=044ca4f80141492b9c128ada543865e8)` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:37:56.903992 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: WARNING py.warnings [None req-09ac06e9-316c-4356-abec-eb29ebb899d3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 09 16:37:56.903992 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: warnings.warn(msg) Aug 09 16:37:56.903992 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: Aug 09 16:37:56.905883 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ac06e9-316c-4356-abec-eb29ebb899d3 admin admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:37:56.919588 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 586/1173] 10.222.0.104 () {60 vars in 1488 bytes} [Tue Aug 9 16:37:56 2022] PUT /identity/v3/projects/c8bd20b38bda4c779d47edbdcc78ab5f/users/6f9a5f7afefa46b297c30ee8130d2c48/roles/044ca4f80141492b9c128ada543865e8 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 16:37:56.920438 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5398ee-5133-4554-bbae-04a27d96a011 None None] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:37:56.924575 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c28493f-a4d2-429a-9f89-cbd0c358f5c9 None None] REQUEST_METHOD: `POST` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:37:56.924868 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c28493f-a4d2-429a-9f89-cbd0c358f5c9 None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:37:56.925142 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c28493f-a4d2-429a-9f89-cbd0c358f5c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:37:56.943766 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.auth.core [None req-7c28493f-a4d2-429a-9f89-cbd0c358f5c9 None None] MFA Rules not processed for user `cd0c59114b4e47af86cbee7e2a704cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=87276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:37:56.944979 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.fernet_utils [None req-7c28493f-a4d2-429a-9f89-cbd0c358f5c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:37:56.968853 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d639dec4-7763-4b4c-994a-f945446f8841 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da49ba8d1a21406eac55503b42fea65b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63557f0ff1ce4ae49899b4627bafd94e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:37:56.969458 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d639dec4-7763-4b4c-994a-f945446f8841 service neutron] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:37:56.969764 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d639dec4-7763-4b4c-994a-f945446f8841 service neutron] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:37:56.970086 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d639dec4-7763-4b4c-994a-f945446f8841 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:37:57.006952 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 587/1174] 10.222.0.104 () {58 vars in 963 bytes} [Tue Aug 9 16:37:56 2022] POST /identity/v3/auth/tokens => generated 2807 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 16:37:57.031069 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d639dec4-7763-4b4c-994a-f945446f8841 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:37:57.032538 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d639dec4-7763-4b4c-994a-f945446f8841 service neutron] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:37:57.038065 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:37:57.039608 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c28493f-a4d2-429a-9f89-cbd0c358f5c9 None None] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:37:57.043237 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 588/1175] 10.222.0.104 () {60 vars in 1370 bytes} [Tue Aug 9 16:37:56 2022] GET /identity/v3/auth/tokens => generated 2807 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 16:37:57.049410 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c28493f-a4d2-429a-9f89-cbd0c358f5c9 None None] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:37:57.053604 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3655dc-9d7d-45d0-82d8-8c46e581a6b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da49ba8d1a21406eac55503b42fea65b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63557f0ff1ce4ae49899b4627bafd94e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:37:57.054244 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3655dc-9d7d-45d0-82d8-8c46e581a6b4 service neutron] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:37:57.054507 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3655dc-9d7d-45d0-82d8-8c46e581a6b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:37:57.054779 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3655dc-9d7d-45d0-82d8-8c46e581a6b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:37:57.064239 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3655dc-9d7d-45d0-82d8-8c46e581a6b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:37:57.065699 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3655dc-9d7d-45d0-82d8-8c46e581a6b4 service neutron] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:37:57.077362 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 588/1176] 10.222.0.104 () {60 vars in 1370 bytes} [Tue Aug 9 16:37:57 2022] GET /identity/v3/auth/tokens => generated 2807 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 16:38:02.236079 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc066189-df1d-4a78-8954-32465b8da06b None None] REQUEST_METHOD: `POST` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:38:02.236601 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc066189-df1d-4a78-8954-32465b8da06b None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:38:02.236601 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc066189-df1d-4a78-8954-32465b8da06b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:38:02.305815 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.auth.core [None req-fc066189-df1d-4a78-8954-32465b8da06b None None] MFA Rules not processed for user `6f9a5f7afefa46b297c30ee8130d2c48`. Rule list: `[]` (Enabled: `True`). {{(pid=87275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:38:02.306205 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.fernet_utils [None req-fc066189-df1d-4a78-8954-32465b8da06b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:38:02.419034 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 589/1177] 10.222.0.104 () {58 vars in 963 bytes} [Tue Aug 9 16:38:02 2022] POST /identity/v3/auth/tokens => generated 2830 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 16:38:02.422960 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3655dc-9d7d-45d0-82d8-8c46e581a6b4 service neutron] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:38:02.442428 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3655dc-9d7d-45d0-82d8-8c46e581a6b4 service neutron] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:38:02.472717 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3791c9df-a9ed-45aa-bbb9-bed5c6c830bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce95c8faa1d4165b111ca9c55852804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:38:02.473533 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3791c9df-a9ed-45aa-bbb9-bed5c6c830bc admin admin] REQUEST_METHOD: `POST` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:38:02.473774 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3791c9df-a9ed-45aa-bbb9-bed5c6c830bc admin admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:38:02.474079 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3791c9df-a9ed-45aa-bbb9-bed5c6c830bc admin admin] PATH_INFO: `/v3/projects` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:38:02.474728 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3791c9df-a9ed-45aa-bbb9-bed5c6c830bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:38:02.477232 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3791c9df-a9ed-45aa-bbb9-bed5c6c830bc admin admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:38:02.520835 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 589/1178] 10.222.0.104 () {60 vars in 1158 bytes} [Tue Aug 9 16:38:02 2022] POST /identity/v3/projects => generated 382 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 16:38:02.527058 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc066189-df1d-4a78-8954-32465b8da06b None None] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:38:02.539692 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc066189-df1d-4a78-8954-32465b8da06b None None] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:38:02.696313 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40538282-7b55-49a3-8f36-69e19d89ea3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce95c8faa1d4165b111ca9c55852804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:38:02.696959 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40538282-7b55-49a3-8f36-69e19d89ea3c admin admin] REQUEST_METHOD: `POST` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:38:02.697240 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40538282-7b55-49a3-8f36-69e19d89ea3c admin admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:38:02.697514 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40538282-7b55-49a3-8f36-69e19d89ea3c admin admin] PATH_INFO: `/v3/users` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:38:02.698212 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40538282-7b55-49a3-8f36-69e19d89ea3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:38:02.700159 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40538282-7b55-49a3-8f36-69e19d89ea3c admin admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:38:02.747870 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 590/1179] 10.222.0.104 () {60 vars in 1149 bytes} [Tue Aug 9 16:38:02 2022] POST /identity/v3/users => generated 298 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 16:38:02.748662 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3791c9df-a9ed-45aa-bbb9-bed5c6c830bc admin admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:38:02.782436 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3791c9df-a9ed-45aa-bbb9-bed5c6c830bc admin admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:38:02.790039 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bad1a2-330d-454f-bbd8-0518f869fc4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce95c8faa1d4165b111ca9c55852804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:38:02.790678 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bad1a2-330d-454f-bbd8-0518f869fc4f admin admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:38:02.790959 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bad1a2-330d-454f-bbd8-0518f869fc4f admin admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:38:02.791235 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bad1a2-330d-454f-bbd8-0518f869fc4f admin admin] PATH_INFO: `/v3/roles` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:38:02.791952 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bad1a2-330d-454f-bbd8-0518f869fc4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:38:02.793629 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bad1a2-330d-454f-bbd8-0518f869fc4f admin admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:38:02.806468 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 590/1180] 10.222.0.104 () {58 vars in 1127 bytes} [Tue Aug 9 16:38:02 2022] GET /identity/v3/roles => generated 1427 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 16:38:02.810334 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40538282-7b55-49a3-8f36-69e19d89ea3c admin admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:38:02.828004 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40538282-7b55-49a3-8f36-69e19d89ea3c admin admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:38:02.840658 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6b7af5-0f2f-40c0-b24e-455298866bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce95c8faa1d4165b111ca9c55852804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:38:02.841650 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6b7af5-0f2f-40c0-b24e-455298866bdd admin admin] REQUEST_METHOD: `PUT` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:38:02.842355 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6b7af5-0f2f-40c0-b24e-455298866bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:38:02.842936 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6b7af5-0f2f-40c0-b24e-455298866bdd admin admin] PATH_INFO: `/v3/projects/902465a03c8242f281639896d6aa7953/users/faa8111f8cb84ac09abdae6fd4dc4b96/roles/c0143e35c1344a39a931bbb6bcd5acdc` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:38:02.879782 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6b7af5-0f2f-40c0-b24e-455298866bdd admin admin] RBAC: Authorizing `identity:create_grant(project_id=902465a03c8242f281639896d6aa7953, user_id=faa8111f8cb84ac09abdae6fd4dc4b96, role_id=c0143e35c1344a39a931bbb6bcd5acdc)` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:38:02.885267 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6b7af5-0f2f-40c0-b24e-455298866bdd admin admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:38:02.904500 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 591/1181] 10.222.0.104 () {60 vars in 1488 bytes} [Tue Aug 9 16:38:02 2022] PUT /identity/v3/projects/902465a03c8242f281639896d6aa7953/users/faa8111f8cb84ac09abdae6fd4dc4b96/roles/c0143e35c1344a39a931bbb6bcd5acdc => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 16:38:02.908871 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bad1a2-330d-454f-bbd8-0518f869fc4f admin admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:38:02.929360 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bad1a2-330d-454f-bbd8-0518f869fc4f admin admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:38:03.027129 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcbce62-d6f4-4480-83d6-d6210203d909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce95c8faa1d4165b111ca9c55852804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:38:03.027855 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcbce62-d6f4-4480-83d6-d6210203d909 admin admin] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:38:03.028232 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcbce62-d6f4-4480-83d6-d6210203d909 admin admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:38:03.028700 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcbce62-d6f4-4480-83d6-d6210203d909 admin admin] PATH_INFO: `/v3/roles` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:38:03.029455 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcbce62-d6f4-4480-83d6-d6210203d909 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:38:03.031232 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcbce62-d6f4-4480-83d6-d6210203d909 admin admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:38:03.037682 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:38:03.043705 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 591/1182] 10.222.0.104 () {58 vars in 1127 bytes} [Tue Aug 9 16:38:02 2022] GET /identity/v3/roles => generated 1427 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 16:38:03.047841 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6b7af5-0f2f-40c0-b24e-455298866bdd admin admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:38:03.066309 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6b7af5-0f2f-40c0-b24e-455298866bdd admin admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:38:03.086929 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64088dbf-8f8c-4217-8032-efd1ce278225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce95c8faa1d4165b111ca9c55852804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:38:03.088242 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64088dbf-8f8c-4217-8032-efd1ce278225 admin admin] REQUEST_METHOD: `PUT` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:38:03.088242 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64088dbf-8f8c-4217-8032-efd1ce278225 admin admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:38:03.088242 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64088dbf-8f8c-4217-8032-efd1ce278225 admin admin] PATH_INFO: `/v3/projects/902465a03c8242f281639896d6aa7953/users/faa8111f8cb84ac09abdae6fd4dc4b96/roles/c0143e35c1344a39a931bbb6bcd5acdc` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:38:03.090348 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64088dbf-8f8c-4217-8032-efd1ce278225 admin admin] RBAC: Authorizing `identity:create_grant(project_id=902465a03c8242f281639896d6aa7953, user_id=faa8111f8cb84ac09abdae6fd4dc4b96, role_id=c0143e35c1344a39a931bbb6bcd5acdc)` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:38:03.093015 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64088dbf-8f8c-4217-8032-efd1ce278225 admin admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:38:03.109156 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 592/1183] 10.222.0.104 () {60 vars in 1488 bytes} [Tue Aug 9 16:38:03 2022] PUT /identity/v3/projects/902465a03c8242f281639896d6aa7953/users/faa8111f8cb84ac09abdae6fd4dc4b96/roles/c0143e35c1344a39a931bbb6bcd5acdc => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 16:38:03.148185 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef5c58d-f29c-476f-8fb3-1e2a6b225fcc None None] REQUEST_METHOD: `POST` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:38:03.148739 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef5c58d-f29c-476f-8fb3-1e2a6b225fcc None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:38:03.149012 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef5c58d-f29c-476f-8fb3-1e2a6b225fcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:38:03.204240 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.auth.core [None req-2ef5c58d-f29c-476f-8fb3-1e2a6b225fcc None None] MFA Rules not processed for user `b703ae8427a04f4f93b59e3df51cd312`. Rule list: `[]` (Enabled: `True`). {{(pid=87276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:38:03.205737 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.fernet_utils [None req-2ef5c58d-f29c-476f-8fb3-1e2a6b225fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:38:03.312023 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 592/1184] 10.222.0.104 () {58 vars in 963 bytes} [Tue Aug 9 16:38:03 2022] POST /identity/v3/auth/tokens => generated 2824 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 16:38:03.312946 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64088dbf-8f8c-4217-8032-efd1ce278225 admin admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:38:03.376630 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:38:03.406342 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64088dbf-8f8c-4217-8032-efd1ce278225 admin admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:38:03.411929 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806a19bf-aac1-4f54-a3a0-93a8ed327ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce95c8faa1d4165b111ca9c55852804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:38:03.412734 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806a19bf-aac1-4f54-a3a0-93a8ed327ae7 admin admin] REQUEST_METHOD: `POST` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:38:03.413016 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806a19bf-aac1-4f54-a3a0-93a8ed327ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:38:03.413614 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806a19bf-aac1-4f54-a3a0-93a8ed327ae7 admin admin] PATH_INFO: `/v3/projects` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:38:03.414269 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806a19bf-aac1-4f54-a3a0-93a8ed327ae7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:38:03.416183 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806a19bf-aac1-4f54-a3a0-93a8ed327ae7 admin admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:38:03.480850 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 593/1185] 10.222.0.104 () {60 vars in 1158 bytes} [Tue Aug 9 16:38:03 2022] POST /identity/v3/projects => generated 378 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 16:38:03.484266 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef5c58d-f29c-476f-8fb3-1e2a6b225fcc None None] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:38:03.498283 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef5c58d-f29c-476f-8fb3-1e2a6b225fcc None None] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:38:03.583113 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbda7516-fe90-4a30-92d7-2780f4688f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce95c8faa1d4165b111ca9c55852804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:38:03.583979 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbda7516-fe90-4a30-92d7-2780f4688f31 admin admin] REQUEST_METHOD: `POST` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:38:03.584376 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbda7516-fe90-4a30-92d7-2780f4688f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:38:03.584778 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbda7516-fe90-4a30-92d7-2780f4688f31 admin admin] PATH_INFO: `/v3/users` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:38:03.585527 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbda7516-fe90-4a30-92d7-2780f4688f31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:38:03.588148 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbda7516-fe90-4a30-92d7-2780f4688f31 admin admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:38:03.634627 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 593/1186] 10.222.0.104 () {60 vars in 1149 bytes} [Tue Aug 9 16:38:03 2022] POST /identity/v3/users => generated 296 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 16:38:03.638291 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806a19bf-aac1-4f54-a3a0-93a8ed327ae7 admin admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:38:03.654747 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806a19bf-aac1-4f54-a3a0-93a8ed327ae7 admin admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:38:03.663283 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d502da-f181-4c81-8fe7-8109ff5e1c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce95c8faa1d4165b111ca9c55852804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:38:03.663891 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d502da-f181-4c81-8fe7-8109ff5e1c1f admin admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:38:03.664178 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d502da-f181-4c81-8fe7-8109ff5e1c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:38:03.664629 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d502da-f181-4c81-8fe7-8109ff5e1c1f admin admin] PATH_INFO: `/v3/roles` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:38:03.665521 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d502da-f181-4c81-8fe7-8109ff5e1c1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:38:03.667485 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d502da-f181-4c81-8fe7-8109ff5e1c1f admin admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:38:03.693723 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 594/1187] 10.222.0.104 () {58 vars in 1127 bytes} [Tue Aug 9 16:38:03 2022] GET /identity/v3/roles => generated 1427 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 16:38:03.694892 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbda7516-fe90-4a30-92d7-2780f4688f31 admin admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:38:03.714823 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbda7516-fe90-4a30-92d7-2780f4688f31 admin admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:38:03.720090 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc415726-2a2e-47d4-bdc8-ee7a1336fada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce95c8faa1d4165b111ca9c55852804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:38:03.720783 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc415726-2a2e-47d4-bdc8-ee7a1336fada admin admin] REQUEST_METHOD: `PUT` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:38:03.721061 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc415726-2a2e-47d4-bdc8-ee7a1336fada admin admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:38:03.721330 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc415726-2a2e-47d4-bdc8-ee7a1336fada admin admin] PATH_INFO: `/v3/projects/3b7a7d5e0bd34b71868a2aa8c8861017/users/ede73d7b3cfc4245bd0221a7c88d75e6/roles/c0143e35c1344a39a931bbb6bcd5acdc` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:38:03.765122 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc415726-2a2e-47d4-bdc8-ee7a1336fada admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b7a7d5e0bd34b71868a2aa8c8861017, user_id=ede73d7b3cfc4245bd0221a7c88d75e6, role_id=c0143e35c1344a39a931bbb6bcd5acdc)` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:38:03.770450 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc415726-2a2e-47d4-bdc8-ee7a1336fada admin admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:38:03.788993 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 594/1188] 10.222.0.104 () {60 vars in 1488 bytes} [Tue Aug 9 16:38:03 2022] PUT /identity/v3/projects/3b7a7d5e0bd34b71868a2aa8c8861017/users/ede73d7b3cfc4245bd0221a7c88d75e6/roles/c0143e35c1344a39a931bbb6bcd5acdc => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 16:38:03.792957 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d502da-f181-4c81-8fe7-8109ff5e1c1f admin admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:38:03.803533 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d502da-f181-4c81-8fe7-8109ff5e1c1f admin admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:38:03.924325 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bf6f55-820d-4d4e-881c-28e33eca5506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce95c8faa1d4165b111ca9c55852804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:38:03.925088 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bf6f55-820d-4d4e-881c-28e33eca5506 admin admin] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:38:03.925366 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bf6f55-820d-4d4e-881c-28e33eca5506 admin admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:38:03.925649 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bf6f55-820d-4d4e-881c-28e33eca5506 admin admin] PATH_INFO: `/v3/roles` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:38:03.926336 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bf6f55-820d-4d4e-881c-28e33eca5506 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:38:03.928465 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bf6f55-820d-4d4e-881c-28e33eca5506 admin admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:38:03.954238 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 595/1189] 10.222.0.104 () {58 vars in 1127 bytes} [Tue Aug 9 16:38:03 2022] GET /identity/v3/roles => generated 1427 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 16:38:03.958267 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc415726-2a2e-47d4-bdc8-ee7a1336fada admin admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:38:03.974196 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc415726-2a2e-47d4-bdc8-ee7a1336fada admin admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:38:03.989748 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944d12bc-665c-4724-ad8e-8513a0dbcd25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce95c8faa1d4165b111ca9c55852804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:38:03.991250 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944d12bc-665c-4724-ad8e-8513a0dbcd25 admin admin] REQUEST_METHOD: `PUT` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:38:03.991250 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944d12bc-665c-4724-ad8e-8513a0dbcd25 admin admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:38:03.991613 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944d12bc-665c-4724-ad8e-8513a0dbcd25 admin admin] PATH_INFO: `/v3/projects/3b7a7d5e0bd34b71868a2aa8c8861017/users/ede73d7b3cfc4245bd0221a7c88d75e6/roles/c0143e35c1344a39a931bbb6bcd5acdc` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:38:03.994727 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944d12bc-665c-4724-ad8e-8513a0dbcd25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b7a7d5e0bd34b71868a2aa8c8861017, user_id=ede73d7b3cfc4245bd0221a7c88d75e6, role_id=c0143e35c1344a39a931bbb6bcd5acdc)` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:38:04.000835 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944d12bc-665c-4724-ad8e-8513a0dbcd25 admin admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:38:04.015634 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 595/1190] 10.222.0.104 () {60 vars in 1488 bytes} [Tue Aug 9 16:38:03 2022] PUT /identity/v3/projects/3b7a7d5e0bd34b71868a2aa8c8861017/users/ede73d7b3cfc4245bd0221a7c88d75e6/roles/c0143e35c1344a39a931bbb6bcd5acdc => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 16:38:09.340525 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2d2fd9-9d5c-4599-9113-d8bb11c7ac47 None None] REQUEST_METHOD: `POST` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:38:09.341168 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2d2fd9-9d5c-4599-9113-d8bb11c7ac47 None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:38:09.341168 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2d2fd9-9d5c-4599-9113-d8bb11c7ac47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:38:09.389140 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.auth.core [None req-9c2d2fd9-9d5c-4599-9113-d8bb11c7ac47 None None] MFA Rules not processed for user `faa8111f8cb84ac09abdae6fd4dc4b96`. Rule list: `[]` (Enabled: `True`). {{(pid=87275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:38:09.398378 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.fernet_utils [None req-9c2d2fd9-9d5c-4599-9113-d8bb11c7ac47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:38:09.495635 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 596/1191] 10.222.0.104 () {58 vars in 963 bytes} [Tue Aug 9 16:38:09 2022] POST /identity/v3/auth/tokens => generated 2893 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 16:38:09.514047 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944d12bc-665c-4724-ad8e-8513a0dbcd25 admin admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:38:09.516322 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.fernet_utils [None req-944d12bc-665c-4724-ad8e-8513a0dbcd25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:38:09.614033 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:38:09.675341 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944d12bc-665c-4724-ad8e-8513a0dbcd25 admin admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:38:09.679744 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ed64a2-bec4-47b1-adaf-eb125e6e8df8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '717261252a9a44de8a71c10fda7082b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63557f0ff1ce4ae49899b4627bafd94e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:38:09.680375 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ed64a2-bec4-47b1-adaf-eb125e6e8df8 service glance] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:38:09.680652 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ed64a2-bec4-47b1-adaf-eb125e6e8df8 service glance] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:38:09.680920 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ed64a2-bec4-47b1-adaf-eb125e6e8df8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:38:09.789408 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ed64a2-bec4-47b1-adaf-eb125e6e8df8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:38:09.790963 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ed64a2-bec4-47b1-adaf-eb125e6e8df8 service glance] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:38:09.808390 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 596/1192] 10.222.0.104 () {60 vars in 1370 bytes} [Tue Aug 9 16:38:09 2022] GET /identity/v3/auth/tokens => generated 2830 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 16:38:10.384219 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0677b28a-a4aa-4d63-bf97-714946985bb5 None None] REQUEST_METHOD: `POST` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:38:10.385379 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0677b28a-a4aa-4d63-bf97-714946985bb5 None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:38:10.385657 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0677b28a-a4aa-4d63-bf97-714946985bb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:38:10.426566 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.auth.core [None req-0677b28a-a4aa-4d63-bf97-714946985bb5 None None] MFA Rules not processed for user `ede73d7b3cfc4245bd0221a7c88d75e6`. Rule list: `[]` (Enabled: `True`). {{(pid=87275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:38:10.429509 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.fernet_utils [None req-0677b28a-a4aa-4d63-bf97-714946985bb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:38:10.477064 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:38:10.534025 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 597/1193] 10.222.0.104 () {58 vars in 963 bytes} [Tue Aug 9 16:38:10 2022] POST /identity/v3/auth/tokens => generated 2889 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 16:38:10.541611 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ed64a2-bec4-47b1-adaf-eb125e6e8df8 service glance] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:38:10.551570 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ed64a2-bec4-47b1-adaf-eb125e6e8df8 service glance] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:38:10.555730 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d724e88-7dc6-4379-b135-3cb4a3ed9ddc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '717261252a9a44de8a71c10fda7082b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63557f0ff1ce4ae49899b4627bafd94e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:38:10.556585 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d724e88-7dc6-4379-b135-3cb4a3ed9ddc service glance] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:38:10.556585 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d724e88-7dc6-4379-b135-3cb4a3ed9ddc service glance] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:38:10.556933 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d724e88-7dc6-4379-b135-3cb4a3ed9ddc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:38:10.629937 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d724e88-7dc6-4379-b135-3cb4a3ed9ddc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:38:10.633785 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d724e88-7dc6-4379-b135-3cb4a3ed9ddc service glance] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:38:10.644418 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 597/1194] 10.222.0.104 () {60 vars in 1370 bytes} [Tue Aug 9 16:38:10 2022] GET /identity/v3/auth/tokens => generated 2824 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 16:38:18.219540 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db8f94d-e713-4d78-929c-9494f6ce2b23 None None] REQUEST_METHOD: `POST` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:38:18.220128 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db8f94d-e713-4d78-929c-9494f6ce2b23 None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:38:18.220239 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db8f94d-e713-4d78-929c-9494f6ce2b23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:38:18.239719 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.auth.core [None req-8db8f94d-e713-4d78-929c-9494f6ce2b23 None None] MFA Rules not processed for user `6f9a5f7afefa46b297c30ee8130d2c48`. Rule list: `[]` (Enabled: `True`). {{(pid=87275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:38:18.241044 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.fernet_utils [None req-8db8f94d-e713-4d78-929c-9494f6ce2b23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:38:18.247938 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 598/1195] 10.222.0.104 () {58 vars in 963 bytes} [Tue Aug 9 16:38:18 2022] POST /identity/v3/auth/tokens => generated 2830 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 16:38:18.543637 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fd61d5-173e-41c7-b3b6-686d3f21d741 None None] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:38:18.544233 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fd61d5-173e-41c7-b3b6-686d3f21d741 None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:38:18.544392 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fd61d5-173e-41c7-b3b6-686d3f21d741 None None] PATH_INFO: `/` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:38:18.546069 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 598/1196] 10.222.0.104 () {54 vars in 967 bytes} [Tue Aug 9 16:38:18 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:38:18.552275 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca2f821-0f62-414f-9455-abce01beedb7 None None] REQUEST_METHOD: `POST` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:38:18.552530 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca2f821-0f62-414f-9455-abce01beedb7 None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:38:18.552801 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca2f821-0f62-414f-9455-abce01beedb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:38:18.584440 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.auth.core [None req-bca2f821-0f62-414f-9455-abce01beedb7 None None] MFA Rules not processed for user `b4c33c3fc318484d9cdfae778d23f06a`. Rule list: `[]` (Enabled: `True`). {{(pid=87275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:38:18.586343 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.fernet_utils [None req-bca2f821-0f62-414f-9455-abce01beedb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:38:18.652978 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 599/1197] 10.222.0.104 () {58 vars in 1064 bytes} [Tue Aug 9 16:38:18 2022] POST /identity/v3/auth/tokens => generated 2871 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 16:38:18.658525 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee995e0-4afd-4e50-992e-7ed80fae17cb None None] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:38:18.658804 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee995e0-4afd-4e50-992e-7ed80fae17cb None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:38:18.659266 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee995e0-4afd-4e50-992e-7ed80fae17cb None None] PATH_INFO: `/` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:38:18.660548 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 599/1198] 10.222.0.104 () {54 vars in 917 bytes} [Tue Aug 9 16:38:18 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:38:18.665969 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ee8841-15f4-4a18-96a4-80a288680b23 None None] REQUEST_METHOD: `POST` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:38:18.666442 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ee8841-15f4-4a18-96a4-80a288680b23 None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:38:18.666894 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ee8841-15f4-4a18-96a4-80a288680b23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:38:18.687900 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.auth.core [None req-e4ee8841-15f4-4a18-96a4-80a288680b23 None None] MFA Rules not processed for user `b4c33c3fc318484d9cdfae778d23f06a`. Rule list: `[]` (Enabled: `True`). {{(pid=87275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:38:18.689102 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.fernet_utils [None req-e4ee8841-15f4-4a18-96a4-80a288680b23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:38:18.697707 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 600/1199] 10.222.0.104 () {58 vars in 1014 bytes} [Tue Aug 9 16:38:18 2022] POST /identity/v3/auth/tokens => generated 2871 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 16:38:18.710580 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee995e0-4afd-4e50-992e-7ed80fae17cb None None] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:38:18.712657 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.fernet_utils [None req-8ee995e0-4afd-4e50-992e-7ed80fae17cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:38:18.726548 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee995e0-4afd-4e50-992e-7ed80fae17cb None None] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:38:18.730512 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4ac340-24d5-4959-a14b-db5866dba0eb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '717261252a9a44de8a71c10fda7082b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63557f0ff1ce4ae49899b4627bafd94e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:38:18.731139 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4ac340-24d5-4959-a14b-db5866dba0eb service glance] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:38:18.731405 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4ac340-24d5-4959-a14b-db5866dba0eb service glance] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:38:18.731673 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4ac340-24d5-4959-a14b-db5866dba0eb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:38:18.741845 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4ac340-24d5-4959-a14b-db5866dba0eb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:38:18.743486 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4ac340-24d5-4959-a14b-db5866dba0eb service glance] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:38:18.754307 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 600/1200] 10.222.0.104 () {60 vars in 1370 bytes} [Tue Aug 9 16:38:18 2022] GET /identity/v3/auth/tokens => generated 2871 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 16:38:19.113988 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bbd803-e6b4-4b9e-8a9b-6d07af24e520 None None] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:38:19.115138 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bbd803-e6b4-4b9e-8a9b-6d07af24e520 None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:38:19.115411 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bbd803-e6b4-4b9e-8a9b-6d07af24e520 None None] PATH_INFO: `/` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:38:19.116960 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 601/1201] 10.222.0.104 () {54 vars in 917 bytes} [Tue Aug 9 16:38:19 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:38:19.122231 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8509c7-2db8-493f-a27d-a369bbbc35a4 None None] REQUEST_METHOD: `POST` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:38:19.122514 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8509c7-2db8-493f-a27d-a369bbbc35a4 None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:38:19.122787 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8509c7-2db8-493f-a27d-a369bbbc35a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:38:19.201722 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.auth.core [None req-6c8509c7-2db8-493f-a27d-a369bbbc35a4 None None] MFA Rules not processed for user `da49ba8d1a21406eac55503b42fea65b`. Rule list: `[]` (Enabled: `True`). {{(pid=87276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:38:19.203081 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.fernet_utils [None req-6c8509c7-2db8-493f-a27d-a369bbbc35a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:38:19.320214 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 601/1202] 10.222.0.104 () {58 vars in 1014 bytes} [Tue Aug 9 16:38:19 2022] POST /identity/v3/auth/tokens => generated 2689 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 16:38:19.332237 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bbd803-e6b4-4b9e-8a9b-6d07af24e520 None None] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:38:19.343313 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bbd803-e6b4-4b9e-8a9b-6d07af24e520 None None] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:38:19.349237 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af578abe-f9ec-42f3-b48a-9fa2139a4773 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da49ba8d1a21406eac55503b42fea65b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63557f0ff1ce4ae49899b4627bafd94e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:38:19.349850 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af578abe-f9ec-42f3-b48a-9fa2139a4773 service neutron] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:38:19.350809 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af578abe-f9ec-42f3-b48a-9fa2139a4773 service neutron] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:38:19.350953 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af578abe-f9ec-42f3-b48a-9fa2139a4773 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:38:19.360042 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af578abe-f9ec-42f3-b48a-9fa2139a4773 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:38:19.361506 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af578abe-f9ec-42f3-b48a-9fa2139a4773 service neutron] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:38:19.372993 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 602/1203] 10.222.0.104 () {60 vars in 1370 bytes} [Tue Aug 9 16:38:19 2022] GET /identity/v3/auth/tokens => generated 2689 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 16:38:19.963513 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6ea1d0-4bf3-474e-869a-053111308172 None None] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:38:19.964109 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6ea1d0-4bf3-474e-869a-053111308172 None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:38:19.964109 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6ea1d0-4bf3-474e-869a-053111308172 None None] PATH_INFO: `/` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:38:19.965380 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 602/1204] 10.222.0.104 () {54 vars in 967 bytes} [Tue Aug 9 16:38:19 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Aug 09 16:38:19.971978 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c031b5b-c124-46eb-b78d-71f93ec8d3f9 None None] REQUEST_METHOD: `POST` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:38:19.972599 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c031b5b-c124-46eb-b78d-71f93ec8d3f9 None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:38:19.973077 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c031b5b-c124-46eb-b78d-71f93ec8d3f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:38:19.999746 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.auth.core [None req-8c031b5b-c124-46eb-b78d-71f93ec8d3f9 None None] MFA Rules not processed for user `b4c33c3fc318484d9cdfae778d23f06a`. Rule list: `[]` (Enabled: `True`). {{(pid=87275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:38:20.001229 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.fernet_utils [None req-8c031b5b-c124-46eb-b78d-71f93ec8d3f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:38:20.014476 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6ea1d0-4bf3-474e-869a-053111308172 None None] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:38:20.031974 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:38:20.035212 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 603/1205] 10.222.0.104 () {58 vars in 1064 bytes} [Tue Aug 9 16:38:19 2022] POST /identity/v3/auth/tokens => generated 2871 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 16:38:20.043739 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f61b28-1429-471d-aac8-9296199ff7a2 None None] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:38:20.045517 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f61b28-1429-471d-aac8-9296199ff7a2 None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:38:20.045982 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f61b28-1429-471d-aac8-9296199ff7a2 None None] PATH_INFO: `/` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:38:20.054159 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 604/1206] 10.222.0.104 () {54 vars in 917 bytes} [Tue Aug 9 16:38:20 2022] GET /identity => generated 271 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:38:20.055648 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b275db60-836e-4ea6-8405-8227ae784efd None None] REQUEST_METHOD: `POST` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:38:20.056104 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b275db60-836e-4ea6-8405-8227ae784efd None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:38:20.056522 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b275db60-836e-4ea6-8405-8227ae784efd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:38:20.116902 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.auth.core [None req-b275db60-836e-4ea6-8405-8227ae784efd None None] MFA Rules not processed for user `b4c33c3fc318484d9cdfae778d23f06a`. Rule list: `[]` (Enabled: `True`). {{(pid=87275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:38:20.124200 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.fernet_utils [None req-b275db60-836e-4ea6-8405-8227ae784efd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:38:20.147765 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 605/1207] 10.222.0.104 () {58 vars in 1014 bytes} [Tue Aug 9 16:38:20 2022] POST /identity/v3/auth/tokens => generated 2871 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 16:38:20.171912 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b275db60-836e-4ea6-8405-8227ae784efd None None] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:38:20.196312 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6ea1d0-4bf3-474e-869a-053111308172 None None] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:38:20.202826 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b275db60-836e-4ea6-8405-8227ae784efd None None] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:38:20.214306 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec1b31a-ae75-4101-8480-ba205ad8201c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da49ba8d1a21406eac55503b42fea65b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63557f0ff1ce4ae49899b4627bafd94e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:38:20.215163 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec1b31a-ae75-4101-8480-ba205ad8201c service neutron] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:38:20.216266 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec1b31a-ae75-4101-8480-ba205ad8201c service neutron] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:38:20.216623 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec1b31a-ae75-4101-8480-ba205ad8201c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:38:20.217320 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448cc87d-8f71-4121-92f9-31b7e5583839 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfd1352d64de487ca4675cbe113e919f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63557f0ff1ce4ae49899b4627bafd94e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:38:20.223372 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448cc87d-8f71-4121-92f9-31b7e5583839 service placement] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:38:20.224900 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448cc87d-8f71-4121-92f9-31b7e5583839 service placement] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:38:20.226311 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448cc87d-8f71-4121-92f9-31b7e5583839 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:38:20.232613 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec1b31a-ae75-4101-8480-ba205ad8201c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:38:20.234120 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec1b31a-ae75-4101-8480-ba205ad8201c service neutron] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:38:20.235322 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.fernet_utils [None req-448cc87d-8f71-4121-92f9-31b7e5583839 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:38:20.251337 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 606/1208] 10.222.0.104 () {60 vars in 1370 bytes} [Tue Aug 9 16:38:20 2022] GET /identity/v3/auth/tokens => generated 2871 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 16:38:20.265348 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448cc87d-8f71-4121-92f9-31b7e5583839 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:38:20.268235 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448cc87d-8f71-4121-92f9-31b7e5583839 service placement] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:38:20.311781 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 603/1209] 10.222.0.104 () {60 vars in 1370 bytes} [Tue Aug 9 16:38:20 2022] GET /identity/v3/auth/tokens => generated 2876 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 16:38:30.246065 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=75 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:38:30.282254 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=28 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:38:33.880825 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a29245-dadb-4681-888e-9806b0ceae5e None None] REQUEST_METHOD: `POST` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:38:33.881965 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a29245-dadb-4681-888e-9806b0ceae5e None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:38:33.881965 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a29245-dadb-4681-888e-9806b0ceae5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:38:33.902130 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.auth.core [None req-16a29245-dadb-4681-888e-9806b0ceae5e None None] MFA Rules not processed for user `da49ba8d1a21406eac55503b42fea65b`. Rule list: `[]` (Enabled: `True`). {{(pid=87275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:38:33.903340 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.fernet_utils [None req-16a29245-dadb-4681-888e-9806b0ceae5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:38:33.909929 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 607/1210] 10.222.0.121 () {58 vars in 1020 bytes} [Tue Aug 9 16:38:33 2022] POST /identity/v3/auth/tokens => generated 2689 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 16:38:33.923003 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448cc87d-8f71-4121-92f9-31b7e5583839 service placement] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:38:33.924395 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.fernet_utils [None req-448cc87d-8f71-4121-92f9-31b7e5583839 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:38:33.937514 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448cc87d-8f71-4121-92f9-31b7e5583839 service placement] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:38:33.941425 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53fb683-cfbc-4f31-8b74-7d02b31bf33a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da49ba8d1a21406eac55503b42fea65b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63557f0ff1ce4ae49899b4627bafd94e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:38:33.942145 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53fb683-cfbc-4f31-8b74-7d02b31bf33a service neutron] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:38:33.942420 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53fb683-cfbc-4f31-8b74-7d02b31bf33a service neutron] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:38:33.942773 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53fb683-cfbc-4f31-8b74-7d02b31bf33a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:38:33.951090 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53fb683-cfbc-4f31-8b74-7d02b31bf33a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:38:33.953021 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53fb683-cfbc-4f31-8b74-7d02b31bf33a service neutron] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:38:33.961816 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 604/1211] 10.222.0.104 () {60 vars in 1370 bytes} [Tue Aug 9 16:38:33 2022] GET /identity/v3/auth/tokens => generated 2689 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 16:38:34.766563 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc216f5-7519-4a1e-b12a-fcd40d49d472 None None] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:38:34.766699 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc216f5-7519-4a1e-b12a-fcd40d49d472 None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:38:34.766902 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc216f5-7519-4a1e-b12a-fcd40d49d472 None None] PATH_INFO: `/` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:38:34.768693 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 608/1212] 10.222.0.104 () {54 vars in 926 bytes} [Tue Aug 9 16:38:34 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:38:34.791697 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23977b0d-9b10-4721-b77b-0297bfa480f7 None None] REQUEST_METHOD: `POST` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:38:34.792005 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23977b0d-9b10-4721-b77b-0297bfa480f7 None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:38:34.792278 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23977b0d-9b10-4721-b77b-0297bfa480f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:38:34.822395 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.auth.core [None req-23977b0d-9b10-4721-b77b-0297bfa480f7 None None] MFA Rules not processed for user `b4c33c3fc318484d9cdfae778d23f06a`. Rule list: `[]` (Enabled: `True`). {{(pid=87276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:38:34.824159 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.fernet_utils [None req-23977b0d-9b10-4721-b77b-0297bfa480f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:38:34.836417 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 605/1213] 10.222.0.104 () {58 vars in 1023 bytes} [Tue Aug 9 16:38:34 2022] POST /identity/v3/auth/tokens => generated 2871 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 16:38:34.862510 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc216f5-7519-4a1e-b12a-fcd40d49d472 None None] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:38:34.878608 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc216f5-7519-4a1e-b12a-fcd40d49d472 None None] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:38:34.885634 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034db87f-2185-4749-962b-12d63743196b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4c33c3fc318484d9cdfae778d23f06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63557f0ff1ce4ae49899b4627bafd94e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:38:34.886301 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034db87f-2185-4749-962b-12d63743196b service nova] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:38:34.886550 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034db87f-2185-4749-962b-12d63743196b service nova] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:38:34.886826 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034db87f-2185-4749-962b-12d63743196b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:38:34.897307 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034db87f-2185-4749-962b-12d63743196b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:38:34.901160 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034db87f-2185-4749-962b-12d63743196b service nova] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:38:34.919759 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 609/1214] 10.222.0.104 () {60 vars in 1370 bytes} [Tue Aug 9 16:38:34 2022] GET /identity/v3/auth/tokens => generated 2871 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 16:38:42.978544 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e70c1c-dd68-4438-a3c0-d9899c06b04d None None] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:38:42.979191 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e70c1c-dd68-4438-a3c0-d9899c06b04d None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:38:42.979191 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e70c1c-dd68-4438-a3c0-d9899c06b04d None None] PATH_INFO: `/` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:38:42.981203 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 606/1215] 10.222.0.104 () {54 vars in 926 bytes} [Tue Aug 9 16:38:42 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:38:42.992382 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f7ce9e-c10a-46a7-b9c9-6f161d2ba255 None None] REQUEST_METHOD: `POST` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:38:42.992976 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f7ce9e-c10a-46a7-b9c9-6f161d2ba255 None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:38:42.992976 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f7ce9e-c10a-46a7-b9c9-6f161d2ba255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:38:43.023831 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.auth.core [None req-37f7ce9e-c10a-46a7-b9c9-6f161d2ba255 None None] MFA Rules not processed for user `b4c33c3fc318484d9cdfae778d23f06a`. Rule list: `[]` (Enabled: `True`). {{(pid=87275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:38:43.025054 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.fernet_utils [None req-37f7ce9e-c10a-46a7-b9c9-6f161d2ba255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:38:43.035697 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 610/1216] 10.222.0.104 () {58 vars in 1023 bytes} [Tue Aug 9 16:38:42 2022] POST /identity/v3/auth/tokens => generated 2871 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 16:38:43.054543 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e70c1c-dd68-4438-a3c0-d9899c06b04d None None] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:38:43.069395 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e70c1c-dd68-4438-a3c0-d9899c06b04d None None] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:38:43.081414 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14548305-c231-4f98-97c9-29832ec84a79 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4c33c3fc318484d9cdfae778d23f06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63557f0ff1ce4ae49899b4627bafd94e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:38:43.082502 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14548305-c231-4f98-97c9-29832ec84a79 service nova] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:38:43.082772 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14548305-c231-4f98-97c9-29832ec84a79 service nova] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:38:43.083064 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14548305-c231-4f98-97c9-29832ec84a79 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:38:43.092823 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14548305-c231-4f98-97c9-29832ec84a79 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:38:43.094902 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14548305-c231-4f98-97c9-29832ec84a79 service nova] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:38:43.106692 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 607/1217] 10.222.0.104 () {60 vars in 1370 bytes} [Tue Aug 9 16:38:43 2022] GET /identity/v3/auth/tokens => generated 2871 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 16:38:53.018575 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=12 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:38:53.101086 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=15 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:38:56.648607 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f7ce9e-c10a-46a7-b9c9-6f161d2ba255 None None] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:38:56.658031 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f7ce9e-c10a-46a7-b9c9-6f161d2ba255 None None] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:38:56.661722 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2e324e-135d-4bff-b76e-1fd73734120c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da49ba8d1a21406eac55503b42fea65b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63557f0ff1ce4ae49899b4627bafd94e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:38:56.662361 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2e324e-135d-4bff-b76e-1fd73734120c service neutron] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:38:56.662691 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2e324e-135d-4bff-b76e-1fd73734120c service neutron] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:38:56.663485 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2e324e-135d-4bff-b76e-1fd73734120c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:38:56.672826 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2e324e-135d-4bff-b76e-1fd73734120c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:38:56.674292 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2e324e-135d-4bff-b76e-1fd73734120c service neutron] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:38:56.683826 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 611/1218] 10.222.0.104 () {60 vars in 1370 bytes} [Tue Aug 9 16:38:56 2022] GET /identity/v3/auth/tokens => generated 2893 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 16:39:01.212675 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f57953-0a39-43c0-b47a-98c45838e3b6 None None] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:39:01.213310 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f57953-0a39-43c0-b47a-98c45838e3b6 None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:39:01.213310 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f57953-0a39-43c0-b47a-98c45838e3b6 None None] PATH_INFO: `/` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:39:01.214767 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 608/1219] 10.222.0.104 () {54 vars in 926 bytes} [Tue Aug 9 16:39:01 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:39:01.227262 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6005f7ba-31f2-4a0b-8ff5-e27f38429d06 None None] REQUEST_METHOD: `POST` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:39:01.228335 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6005f7ba-31f2-4a0b-8ff5-e27f38429d06 None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:39:01.228838 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6005f7ba-31f2-4a0b-8ff5-e27f38429d06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:39:01.255120 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.auth.core [None req-6005f7ba-31f2-4a0b-8ff5-e27f38429d06 None None] MFA Rules not processed for user `b4c33c3fc318484d9cdfae778d23f06a`. Rule list: `[]` (Enabled: `True`). {{(pid=87275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:39:01.257271 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.fernet_utils [None req-6005f7ba-31f2-4a0b-8ff5-e27f38429d06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:39:01.269483 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 612/1220] 10.222.0.104 () {58 vars in 1023 bytes} [Tue Aug 9 16:39:01 2022] POST /identity/v3/auth/tokens => generated 2871 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 16:39:01.285415 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f57953-0a39-43c0-b47a-98c45838e3b6 None None] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:39:01.300657 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f57953-0a39-43c0-b47a-98c45838e3b6 None None] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:39:01.306242 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db69f4d1-c42e-4700-85ba-0111f00e28fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4c33c3fc318484d9cdfae778d23f06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63557f0ff1ce4ae49899b4627bafd94e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:39:01.307108 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db69f4d1-c42e-4700-85ba-0111f00e28fe service nova] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:39:01.307658 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db69f4d1-c42e-4700-85ba-0111f00e28fe service nova] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:39:01.308129 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db69f4d1-c42e-4700-85ba-0111f00e28fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:39:01.318294 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db69f4d1-c42e-4700-85ba-0111f00e28fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:39:01.320154 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db69f4d1-c42e-4700-85ba-0111f00e28fe service nova] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:39:01.336155 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 609/1221] 10.222.0.104 () {60 vars in 1370 bytes} [Tue Aug 9 16:39:01 2022] GET /identity/v3/auth/tokens => generated 2871 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 16:39:08.555314 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc84ed79-a5ee-4803-b6fe-b9b7f30afc5a None None] REQUEST_METHOD: `POST` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:39:08.555881 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc84ed79-a5ee-4803-b6fe-b9b7f30afc5a None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:39:08.555881 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc84ed79-a5ee-4803-b6fe-b9b7f30afc5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:39:08.574184 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.auth.core [None req-bc84ed79-a5ee-4803-b6fe-b9b7f30afc5a None None] MFA Rules not processed for user `b703ae8427a04f4f93b59e3df51cd312`. Rule list: `[]` (Enabled: `True`). {{(pid=87275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:39:08.575402 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.fernet_utils [None req-bc84ed79-a5ee-4803-b6fe-b9b7f30afc5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:39:08.582240 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 613/1222] 10.222.0.104 () {58 vars in 963 bytes} [Tue Aug 9 16:39:08 2022] POST /identity/v3/auth/tokens => generated 2824 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 16:39:11.327035 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=6 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:39:18.569741 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=12 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:39:34.927432 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04170164-c58f-4029-9f5f-a25494983265 None None] REQUEST_METHOD: `POST` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:39:34.928038 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04170164-c58f-4029-9f5f-a25494983265 None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:39:34.928160 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04170164-c58f-4029-9f5f-a25494983265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:39:34.946768 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.auth.core [None req-04170164-c58f-4029-9f5f-a25494983265 None None] MFA Rules not processed for user `b703ae8427a04f4f93b59e3df51cd312`. Rule list: `[]` (Enabled: `True`). {{(pid=87276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:39:34.947979 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.fernet_utils [None req-04170164-c58f-4029-9f5f-a25494983265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:39:34.954765 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 610/1223] 10.222.0.104 () {58 vars in 963 bytes} [Tue Aug 9 16:39:34 2022] POST /identity/v3/auth/tokens => generated 2824 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 16:39:35.217996 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a340e8ff-c2a8-4d0c-b858-967182370a6a None None] REQUEST_METHOD: `POST` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:39:35.218484 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a340e8ff-c2a8-4d0c-b858-967182370a6a None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:39:35.218574 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a340e8ff-c2a8-4d0c-b858-967182370a6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:39:35.243349 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.auth.core [None req-a340e8ff-c2a8-4d0c-b858-967182370a6a None None] MFA Rules not processed for user `da49ba8d1a21406eac55503b42fea65b`. Rule list: `[]` (Enabled: `True`). {{(pid=87275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:39:35.244531 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.fernet_utils [None req-a340e8ff-c2a8-4d0c-b858-967182370a6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:39:35.250999 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 614/1224] 10.222.0.104 () {58 vars in 1014 bytes} [Tue Aug 9 16:39:35 2022] POST /identity/v3/auth/tokens => generated 2689 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 16:39:35.262825 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04170164-c58f-4029-9f5f-a25494983265 None None] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:39:35.272760 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04170164-c58f-4029-9f5f-a25494983265 None None] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:39:35.276324 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da46810-a126-4500-b238-093961ad4350 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da49ba8d1a21406eac55503b42fea65b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63557f0ff1ce4ae49899b4627bafd94e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:39:35.276912 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da46810-a126-4500-b238-093961ad4350 service neutron] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:39:35.277188 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da46810-a126-4500-b238-093961ad4350 service neutron] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:39:35.277455 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da46810-a126-4500-b238-093961ad4350 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:39:35.284216 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da46810-a126-4500-b238-093961ad4350 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:39:35.285636 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da46810-a126-4500-b238-093961ad4350 service neutron] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:39:35.293175 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 611/1225] 10.222.0.104 () {60 vars in 1370 bytes} [Tue Aug 9 16:39:35 2022] GET /identity/v3/auth/tokens => generated 2689 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 16:39:45.238831 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=3 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:39:45.289929 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=9 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:39:49.470241 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa9bb42-7e43-49cf-a553-82ec05313d41 None None] REQUEST_METHOD: `POST` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:39:49.470709 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa9bb42-7e43-49cf-a553-82ec05313d41 None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:39:49.470790 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa9bb42-7e43-49cf-a553-82ec05313d41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:39:49.489183 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.auth.core [None req-3aa9bb42-7e43-49cf-a553-82ec05313d41 None None] MFA Rules not processed for user `b703ae8427a04f4f93b59e3df51cd312`. Rule list: `[]` (Enabled: `True`). {{(pid=87275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:39:49.490464 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.fernet_utils [None req-3aa9bb42-7e43-49cf-a553-82ec05313d41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:39:49.497204 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 615/1226] 10.222.0.104 () {58 vars in 963 bytes} [Tue Aug 9 16:39:49 2022] POST /identity/v3/auth/tokens => generated 2824 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 16:39:59.484604 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=3 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:40:48.823859 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d166f23-d5e0-4d9b-ab8d-46d48d3abb18 None None] REQUEST_METHOD: `POST` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:40:48.824367 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d166f23-d5e0-4d9b-ab8d-46d48d3abb18 None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:40:48.824367 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d166f23-d5e0-4d9b-ab8d-46d48d3abb18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:40:48.843616 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.auth.core [None req-0d166f23-d5e0-4d9b-ab8d-46d48d3abb18 None None] MFA Rules not processed for user `b703ae8427a04f4f93b59e3df51cd312`. Rule list: `[]` (Enabled: `True`). {{(pid=87276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:40:48.844823 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.fernet_utils [None req-0d166f23-d5e0-4d9b-ab8d-46d48d3abb18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:40:48.851968 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 612/1227] 10.222.0.104 () {58 vars in 963 bytes} [Tue Aug 9 16:40:48 2022] POST /identity/v3/auth/tokens => generated 2824 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 16:40:58.838085 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=3 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:41:02.763575 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa9bb42-7e43-49cf-a553-82ec05313d41 None None] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:41:02.782495 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa9bb42-7e43-49cf-a553-82ec05313d41 None None] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:41:02.786534 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a1defa-875b-43c0-bb8a-154337f076c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da49ba8d1a21406eac55503b42fea65b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63557f0ff1ce4ae49899b4627bafd94e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:41:02.787125 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a1defa-875b-43c0-bb8a-154337f076c3 service neutron] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:41:02.787399 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a1defa-875b-43c0-bb8a-154337f076c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:41:02.787671 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a1defa-875b-43c0-bb8a-154337f076c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:41:02.796720 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a1defa-875b-43c0-bb8a-154337f076c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:41:02.798198 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a1defa-875b-43c0-bb8a-154337f076c3 service neutron] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:41:02.807959 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 616/1228] 10.222.0.104 () {60 vars in 1370 bytes} [Tue Aug 9 16:41:02 2022] GET /identity/v3/auth/tokens => generated 2889 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 16:41:12.804037 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=10 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:41:26.016931 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d166f23-d5e0-4d9b-ab8d-46d48d3abb18 None None] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:41:26.038776 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d166f23-d5e0-4d9b-ab8d-46d48d3abb18 None None] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:41:26.043727 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48bd518-4d3d-424a-b200-cbda0af6dc1d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfd1352d64de487ca4675cbe113e919f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63557f0ff1ce4ae49899b4627bafd94e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:41:26.044325 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48bd518-4d3d-424a-b200-cbda0af6dc1d service placement] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:41:26.044596 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48bd518-4d3d-424a-b200-cbda0af6dc1d service placement] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:41:26.044872 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48bd518-4d3d-424a-b200-cbda0af6dc1d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:41:26.053175 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48bd518-4d3d-424a-b200-cbda0af6dc1d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:41:26.054775 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48bd518-4d3d-424a-b200-cbda0af6dc1d service placement] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:41:26.064665 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 613/1229] 10.222.0.104 () {60 vars in 1370 bytes} [Tue Aug 9 16:41:26 2022] GET /identity/v3/auth/tokens => generated 2876 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 16:41:36.060323 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=10 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:43:10.395880 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a1defa-875b-43c0-bb8a-154337f076c3 service neutron] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:43:10.418351 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a1defa-875b-43c0-bb8a-154337f076c3 service neutron] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:43:10.423319 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e43892d-5e31-4232-8543-f435180bbd7e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4c33c3fc318484d9cdfae778d23f06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63557f0ff1ce4ae49899b4627bafd94e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:43:10.423913 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e43892d-5e31-4232-8543-f435180bbd7e service nova] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:43:10.424188 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e43892d-5e31-4232-8543-f435180bbd7e service nova] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:43:10.424482 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e43892d-5e31-4232-8543-f435180bbd7e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:43:10.432502 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e43892d-5e31-4232-8543-f435180bbd7e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:43:10.434132 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e43892d-5e31-4232-8543-f435180bbd7e service nova] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:43:10.443471 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 617/1230] 10.222.0.104 () {60 vars in 1370 bytes} [Tue Aug 9 16:43:10 2022] GET /identity/v3/auth/tokens => generated 2824 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 16:43:15.249853 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c0c80f-1841-48c2-b597-01bff345ddf5 None None] REQUEST_METHOD: `POST` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:43:15.250830 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c0c80f-1841-48c2-b597-01bff345ddf5 None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:43:15.250996 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c0c80f-1841-48c2-b597-01bff345ddf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:43:15.271706 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.auth.core [None req-72c0c80f-1841-48c2-b597-01bff345ddf5 None None] MFA Rules not processed for user `b703ae8427a04f4f93b59e3df51cd312`. Rule list: `[]` (Enabled: `True`). {{(pid=87276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:43:15.272966 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.fernet_utils [None req-72c0c80f-1841-48c2-b597-01bff345ddf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:43:15.281461 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 614/1231] 10.222.0.104 () {58 vars in 963 bytes} [Tue Aug 9 16:43:15 2022] POST /identity/v3/auth/tokens => generated 2824 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 16:43:19.428122 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e43892d-5e31-4232-8543-f435180bbd7e service nova] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:43:19.437969 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e43892d-5e31-4232-8543-f435180bbd7e service nova] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:43:19.441545 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9870021c-27f7-42c0-a978-9d5760f2ed6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da49ba8d1a21406eac55503b42fea65b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63557f0ff1ce4ae49899b4627bafd94e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:43:19.442159 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9870021c-27f7-42c0-a978-9d5760f2ed6b service neutron] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:43:19.442433 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9870021c-27f7-42c0-a978-9d5760f2ed6b service neutron] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:43:19.442699 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9870021c-27f7-42c0-a978-9d5760f2ed6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:43:19.451779 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9870021c-27f7-42c0-a978-9d5760f2ed6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:43:19.453268 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9870021c-27f7-42c0-a978-9d5760f2ed6b service neutron] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:43:19.464692 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 618/1232] 10.222.0.104 () {60 vars in 1370 bytes} [Tue Aug 9 16:43:19 2022] GET /identity/v3/auth/tokens => generated 2871 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 16:43:20.647529 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c0c80f-1841-48c2-b597-01bff345ddf5 None None] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:43:20.658250 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c0c80f-1841-48c2-b597-01bff345ddf5 None None] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:43:20.661838 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb2c061-0525-4a23-b759-3dc1d17720e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da49ba8d1a21406eac55503b42fea65b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63557f0ff1ce4ae49899b4627bafd94e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:43:20.662461 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb2c061-0525-4a23-b759-3dc1d17720e4 service neutron] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:43:20.662737 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb2c061-0525-4a23-b759-3dc1d17720e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:43:20.663007 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb2c061-0525-4a23-b759-3dc1d17720e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:43:20.672532 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb2c061-0525-4a23-b759-3dc1d17720e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:43:20.673967 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb2c061-0525-4a23-b759-3dc1d17720e4 service neutron] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:43:20.683892 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 615/1233] 10.222.0.104 () {60 vars in 1370 bytes} [Tue Aug 9 16:43:20 2022] GET /identity/v3/auth/tokens => generated 2871 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 16:43:29.460006 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=16 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:43:30.679612 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=9 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:43:55.947735 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9870021c-27f7-42c0-a978-9d5760f2ed6b service neutron] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:43:55.958451 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9870021c-27f7-42c0-a978-9d5760f2ed6b service neutron] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:43:55.963701 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f453c456-1136-423c-9251-387c4ff5b019 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4c33c3fc318484d9cdfae778d23f06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63557f0ff1ce4ae49899b4627bafd94e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:43:55.964290 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f453c456-1136-423c-9251-387c4ff5b019 service nova] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:43:55.964565 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f453c456-1136-423c-9251-387c4ff5b019 service nova] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:43:55.964832 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f453c456-1136-423c-9251-387c4ff5b019 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:43:55.973248 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f453c456-1136-423c-9251-387c4ff5b019 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:43:55.974905 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f453c456-1136-423c-9251-387c4ff5b019 service nova] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:43:55.983726 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 619/1234] 10.222.0.104 () {60 vars in 1370 bytes} [Tue Aug 9 16:43:55 2022] GET /identity/v3/auth/tokens => generated 2830 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 16:43:56.551816 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb2c061-0525-4a23-b759-3dc1d17720e4 service neutron] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:43:56.562642 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb2c061-0525-4a23-b759-3dc1d17720e4 service neutron] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:43:56.567516 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e2ddd6-b815-4445-a99d-234157ba8096 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da49ba8d1a21406eac55503b42fea65b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63557f0ff1ce4ae49899b4627bafd94e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:43:56.568910 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e2ddd6-b815-4445-a99d-234157ba8096 service neutron] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:43:56.569464 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e2ddd6-b815-4445-a99d-234157ba8096 service neutron] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:43:56.569836 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e2ddd6-b815-4445-a99d-234157ba8096 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:43:56.579458 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e2ddd6-b815-4445-a99d-234157ba8096 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:43:56.582099 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e2ddd6-b815-4445-a99d-234157ba8096 service neutron] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:43:56.591652 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 616/1235] 10.222.0.104 () {60 vars in 1370 bytes} [Tue Aug 9 16:43:56 2022] GET /identity/v3/auth/tokens => generated 2689 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 16:43:57.884553 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f453c456-1136-423c-9251-387c4ff5b019 service nova] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:43:57.902167 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f453c456-1136-423c-9251-387c4ff5b019 service nova] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:43:57.913507 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9447ba52-3805-4952-b595-362315f3151a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4c33c3fc318484d9cdfae778d23f06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63557f0ff1ce4ae49899b4627bafd94e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:43:57.914458 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9447ba52-3805-4952-b595-362315f3151a service nova] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:43:57.914900 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9447ba52-3805-4952-b595-362315f3151a service nova] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:43:57.915382 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9447ba52-3805-4952-b595-362315f3151a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:43:57.930551 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9447ba52-3805-4952-b595-362315f3151a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:43:57.932866 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9447ba52-3805-4952-b595-362315f3151a service nova] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:43:57.944543 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 620/1236] 10.222.0.104 () {60 vars in 1370 bytes} [Tue Aug 9 16:43:57 2022] GET /identity/v3/auth/tokens => generated 2871 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 16:44:06.588013 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=6 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:44:07.939224 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=12 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:44:11.583033 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d22e95-b0fa-4266-b015-1567ecc28646 None None] REQUEST_METHOD: `POST` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:44:11.583786 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d22e95-b0fa-4266-b015-1567ecc28646 None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:44:11.583786 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d22e95-b0fa-4266-b015-1567ecc28646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:44:11.602600 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.auth.core [None req-64d22e95-b0fa-4266-b015-1567ecc28646 None None] MFA Rules not processed for user `6f9a5f7afefa46b297c30ee8130d2c48`. Rule list: `[]` (Enabled: `True`). {{(pid=87276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:44:11.603781 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.fernet_utils [None req-64d22e95-b0fa-4266-b015-1567ecc28646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:44:11.610832 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 617/1237] 10.222.0.104 () {58 vars in 963 bytes} [Tue Aug 9 16:44:11 2022] POST /identity/v3/auth/tokens => generated 2830 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 16:44:11.864310 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9447ba52-3805-4952-b595-362315f3151a service nova] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:44:11.873714 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9447ba52-3805-4952-b595-362315f3151a service nova] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:44:11.877706 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc53206-da0b-421c-aa25-a6efc8024282 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da49ba8d1a21406eac55503b42fea65b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63557f0ff1ce4ae49899b4627bafd94e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:44:11.878319 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc53206-da0b-421c-aa25-a6efc8024282 service neutron] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:44:11.878591 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc53206-da0b-421c-aa25-a6efc8024282 service neutron] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:44:11.878858 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc53206-da0b-421c-aa25-a6efc8024282 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:44:11.886060 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc53206-da0b-421c-aa25-a6efc8024282 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:44:11.887489 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc53206-da0b-421c-aa25-a6efc8024282 service neutron] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:44:11.895633 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 621/1238] 10.222.0.104 () {60 vars in 1370 bytes} [Tue Aug 9 16:44:11 2022] GET /identity/v3/auth/tokens => generated 2689 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 16:44:12.209177 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59b2023-a8d3-4983-8bb0-d64cd144ba0f None None] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:44:12.209462 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59b2023-a8d3-4983-8bb0-d64cd144ba0f None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:44:12.209737 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59b2023-a8d3-4983-8bb0-d64cd144ba0f None None] PATH_INFO: `/` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:44:12.211256 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 618/1239] 10.222.0.104 () {54 vars in 966 bytes} [Tue Aug 9 16:44:12 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:44:12.216328 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea1fe5c-01eb-4e9e-b869-1c2be10ed4dd None None] REQUEST_METHOD: `POST` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:44:12.216620 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea1fe5c-01eb-4e9e-b869-1c2be10ed4dd None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:44:12.216892 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea1fe5c-01eb-4e9e-b869-1c2be10ed4dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:44:12.280830 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.auth.core [None req-2ea1fe5c-01eb-4e9e-b869-1c2be10ed4dd None None] MFA Rules not processed for user `cfd1352d64de487ca4675cbe113e919f`. Rule list: `[]` (Enabled: `True`). {{(pid=87275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:44:12.282082 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.fernet_utils [None req-2ea1fe5c-01eb-4e9e-b869-1c2be10ed4dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:44:12.290884 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 622/1240] 10.222.0.104 () {58 vars in 1063 bytes} [Tue Aug 9 16:44:12 2022] POST /identity/v3/auth/tokens => generated 2876 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 16:44:12.299032 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59b2023-a8d3-4983-8bb0-d64cd144ba0f None None] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:44:12.312558 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59b2023-a8d3-4983-8bb0-d64cd144ba0f None None] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:44:12.318145 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a96127c-fa4d-4d99-896e-30edd5844ed9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfd1352d64de487ca4675cbe113e919f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63557f0ff1ce4ae49899b4627bafd94e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:44:12.318730 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a96127c-fa4d-4d99-896e-30edd5844ed9 service placement] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:44:12.319007 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a96127c-fa4d-4d99-896e-30edd5844ed9 service placement] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:44:12.319276 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a96127c-fa4d-4d99-896e-30edd5844ed9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:44:12.327505 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a96127c-fa4d-4d99-896e-30edd5844ed9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:44:12.329002 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a96127c-fa4d-4d99-896e-30edd5844ed9 service placement] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:44:12.339170 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 619/1241] 10.222.0.104 () {60 vars in 1370 bytes} [Tue Aug 9 16:44:12 2022] GET /identity/v3/auth/tokens => generated 2876 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 16:44:22.278697 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=24 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:44:22.335448 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=9 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:44:30.522292 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea1fe5c-01eb-4e9e-b869-1c2be10ed4dd None None] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:44:30.536522 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea1fe5c-01eb-4e9e-b869-1c2be10ed4dd None None] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:44:30.540366 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009432bc-2299-4e2c-ae9b-9d8e32f65e13 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4c33c3fc318484d9cdfae778d23f06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63557f0ff1ce4ae49899b4627bafd94e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:44:30.540987 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009432bc-2299-4e2c-ae9b-9d8e32f65e13 service nova] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:44:30.541372 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009432bc-2299-4e2c-ae9b-9d8e32f65e13 service nova] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:44:30.541583 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009432bc-2299-4e2c-ae9b-9d8e32f65e13 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:44:30.551911 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009432bc-2299-4e2c-ae9b-9d8e32f65e13 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:44:30.553668 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009432bc-2299-4e2c-ae9b-9d8e32f65e13 service nova] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:44:30.565753 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 623/1242] 10.222.0.104 () {60 vars in 1370 bytes} [Tue Aug 9 16:44:30 2022] GET /identity/v3/auth/tokens => generated 2871 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 16:44:39.533307 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a96127c-fa4d-4d99-896e-30edd5844ed9 service placement] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:44:39.542309 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a96127c-fa4d-4d99-896e-30edd5844ed9 service placement] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:44:39.545838 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07a2f2b-3b7c-46a5-8222-2a35bde27c0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da49ba8d1a21406eac55503b42fea65b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63557f0ff1ce4ae49899b4627bafd94e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:44:39.546446 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07a2f2b-3b7c-46a5-8222-2a35bde27c0a service neutron] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:44:39.546719 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07a2f2b-3b7c-46a5-8222-2a35bde27c0a service neutron] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:44:39.546986 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07a2f2b-3b7c-46a5-8222-2a35bde27c0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:44:39.556030 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07a2f2b-3b7c-46a5-8222-2a35bde27c0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:44:39.557418 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07a2f2b-3b7c-46a5-8222-2a35bde27c0a service neutron] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:44:39.567474 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 620/1243] 10.222.0.104 () {60 vars in 1370 bytes} [Tue Aug 9 16:44:39 2022] GET /identity/v3/auth/tokens => generated 2893 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 16:44:40.561493 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=6 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:44:41.194434 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009432bc-2299-4e2c-ae9b-9d8e32f65e13 service nova] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:44:41.205323 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009432bc-2299-4e2c-ae9b-9d8e32f65e13 service nova] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:44:41.211465 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd6c4e0-5925-4911-8087-ef748f143cae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4c33c3fc318484d9cdfae778d23f06a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63557f0ff1ce4ae49899b4627bafd94e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:44:41.212087 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd6c4e0-5925-4911-8087-ef748f143cae service nova] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:44:41.212376 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd6c4e0-5925-4911-8087-ef748f143cae service nova] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:44:41.212634 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd6c4e0-5925-4911-8087-ef748f143cae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:44:41.223487 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd6c4e0-5925-4911-8087-ef748f143cae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:44:41.225129 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd6c4e0-5925-4911-8087-ef748f143cae service nova] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:44:41.237185 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 624/1244] 10.222.0.104 () {60 vars in 1370 bytes} [Tue Aug 9 16:44:41 2022] GET /identity/v3/auth/tokens => generated 2871 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 16:44:49.562882 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=6 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:44:51.232119 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=6 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:45:35.503139 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990665cb-81ad-4625-aa38-a6e290934161 None None] REQUEST_METHOD: `POST` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:45:35.503648 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990665cb-81ad-4625-aa38-a6e290934161 None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:45:35.503758 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990665cb-81ad-4625-aa38-a6e290934161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:45:35.522317 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.auth.core [None req-990665cb-81ad-4625-aa38-a6e290934161 None None] MFA Rules not processed for user `b703ae8427a04f4f93b59e3df51cd312`. Rule list: `[]` (Enabled: `True`). {{(pid=87276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:45:35.523495 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.fernet_utils [None req-990665cb-81ad-4625-aa38-a6e290934161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:45:35.530779 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 621/1245] 10.222.0.104 () {58 vars in 963 bytes} [Tue Aug 9 16:45:35 2022] POST /identity/v3/auth/tokens => generated 2824 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 16:45:35.852049 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd6c4e0-5925-4911-8087-ef748f143cae service nova] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:45:35.861091 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd6c4e0-5925-4911-8087-ef748f143cae service nova] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:45:35.864728 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582737ba-64c0-4db5-a32d-f79365b01555 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da49ba8d1a21406eac55503b42fea65b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63557f0ff1ce4ae49899b4627bafd94e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:45:35.865315 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582737ba-64c0-4db5-a32d-f79365b01555 service neutron] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:45:35.865593 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582737ba-64c0-4db5-a32d-f79365b01555 service neutron] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:45:35.865863 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582737ba-64c0-4db5-a32d-f79365b01555 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:45:35.872664 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582737ba-64c0-4db5-a32d-f79365b01555 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:45:35.874608 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582737ba-64c0-4db5-a32d-f79365b01555 service neutron] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:45:35.882499 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 625/1246] 10.222.0.104 () {60 vars in 1370 bytes} [Tue Aug 9 16:45:35 2022] GET /identity/v3/auth/tokens => generated 2689 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 16:45:45.517661 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=3 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:45:45.879304 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=6 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:46:31.971545 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990665cb-81ad-4625-aa38-a6e290934161 None None] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:46:32.011838 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990665cb-81ad-4625-aa38-a6e290934161 None None] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:46:32.017357 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fe68e2-601a-4681-96b3-3f21e587d0ce service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfd1352d64de487ca4675cbe113e919f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63557f0ff1ce4ae49899b4627bafd94e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:46:32.017889 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fe68e2-601a-4681-96b3-3f21e587d0ce service placement] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:46:32.018190 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fe68e2-601a-4681-96b3-3f21e587d0ce service placement] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:46:32.018458 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fe68e2-601a-4681-96b3-3f21e587d0ce service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:46:32.020261 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.fernet_utils [None req-c1fe68e2-601a-4681-96b3-3f21e587d0ce service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:46:32.050067 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fe68e2-601a-4681-96b3-3f21e587d0ce service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:46:32.051631 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fe68e2-601a-4681-96b3-3f21e587d0ce service placement] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:46:32.061553 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 622/1247] 10.222.0.104 () {60 vars in 1370 bytes} [Tue Aug 9 16:46:31 2022] GET /identity/v3/auth/tokens => generated 2876 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 16:46:42.057159 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=28 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:47:42.366005 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582737ba-64c0-4db5-a32d-f79365b01555 service neutron] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:47:42.367690 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.fernet_utils [None req-582737ba-64c0-4db5-a32d-f79365b01555 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:47:42.390996 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582737ba-64c0-4db5-a32d-f79365b01555 service neutron] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:47:42.394754 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b494de-46e1-4596-9ae6-86f8c43ec49c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da49ba8d1a21406eac55503b42fea65b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63557f0ff1ce4ae49899b4627bafd94e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:47:42.395358 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b494de-46e1-4596-9ae6-86f8c43ec49c service neutron] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:47:42.395637 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b494de-46e1-4596-9ae6-86f8c43ec49c service neutron] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:47:42.395912 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b494de-46e1-4596-9ae6-86f8c43ec49c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:47:42.467236 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b494de-46e1-4596-9ae6-86f8c43ec49c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:47:42.468755 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b494de-46e1-4596-9ae6-86f8c43ec49c service neutron] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:47:42.487267 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 626/1248] 10.222.0.104 () {60 vars in 1370 bytes} [Tue Aug 9 16:47:42 2022] GET /identity/v3/auth/tokens => generated 2807 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 16:47:46.326266 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295c8c87-ff90-46fe-a079-226f80c9c551 None None] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:47:46.326835 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295c8c87-ff90-46fe-a079-226f80c9c551 None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:47:46.326835 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295c8c87-ff90-46fe-a079-226f80c9c551 None None] PATH_INFO: `/` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:47:46.328034 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 623/1249] 10.222.0.104 () {54 vars in 926 bytes} [Tue Aug 9 16:47:46 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:47:46.354560 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41662ec8-a9f7-4c2c-b509-064fef702dec None None] REQUEST_METHOD: `POST` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:47:46.355024 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41662ec8-a9f7-4c2c-b509-064fef702dec None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:47:46.355134 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41662ec8-a9f7-4c2c-b509-064fef702dec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:47:46.385127 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.auth.core [None req-41662ec8-a9f7-4c2c-b509-064fef702dec None None] MFA Rules not processed for user `cfd1352d64de487ca4675cbe113e919f`. Rule list: `[]` (Enabled: `True`). {{(pid=87275) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:47:46.386830 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.fernet_utils [None req-41662ec8-a9f7-4c2c-b509-064fef702dec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:47:46.397500 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 627/1250] 10.222.0.104 () {58 vars in 1023 bytes} [Tue Aug 9 16:47:46 2022] POST /identity/v3/auth/tokens => generated 2876 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 16:47:46.446887 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295c8c87-ff90-46fe-a079-226f80c9c551 None None] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:47:46.448969 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.fernet_utils [None req-295c8c87-ff90-46fe-a079-226f80c9c551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:47:46.477507 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295c8c87-ff90-46fe-a079-226f80c9c551 None None] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:47:46.483609 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7667c52-b737-4391-876c-f6eae682ea8b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfd1352d64de487ca4675cbe113e919f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63557f0ff1ce4ae49899b4627bafd94e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:47:46.484336 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7667c52-b737-4391-876c-f6eae682ea8b service placement] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:47:46.484688 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7667c52-b737-4391-876c-f6eae682ea8b service placement] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:47:46.485071 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7667c52-b737-4391-876c-f6eae682ea8b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:47:46.495468 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7667c52-b737-4391-876c-f6eae682ea8b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:47:46.498271 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7667c52-b737-4391-876c-f6eae682ea8b service placement] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:47:46.508544 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 624/1251] 10.222.0.104 () {60 vars in 1370 bytes} [Tue Aug 9 16:47:46 2022] GET /identity/v3/auth/tokens => generated 2876 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 16:47:49.545253 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41662ec8-a9f7-4c2c-b509-064fef702dec None None] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:47:49.559979 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41662ec8-a9f7-4c2c-b509-064fef702dec None None] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:47:49.565926 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d30443f-f4a7-4b1a-8aeb-9fd8f2b0edd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce95c8faa1d4165b111ca9c55852804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:47:49.566591 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d30443f-f4a7-4b1a-8aeb-9fd8f2b0edd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:47:49.566865 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d30443f-f4a7-4b1a-8aeb-9fd8f2b0edd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:47:49.567131 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d30443f-f4a7-4b1a-8aeb-9fd8f2b0edd4 admin admin] PATH_INFO: `/v3/users/6f9a5f7afefa46b297c30ee8130d2c48` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:47:49.568257 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d30443f-f4a7-4b1a-8aeb-9fd8f2b0edd4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f9a5f7afefa46b297c30ee8130d2c48)` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:47:49.570271 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d30443f-f4a7-4b1a-8aeb-9fd8f2b0edd4 admin admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:47:49.624013 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.notifications [None req-8d30443f-f4a7-4b1a-8aeb-9fd8f2b0edd4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f9a5f7afefa46b297c30ee8130d2c48'} {{(pid=87275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 16:47:49.633732 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.notifications [None req-8d30443f-f4a7-4b1a-8aeb-9fd8f2b0edd4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f9a5f7afefa46b297c30ee8130d2c48'} {{(pid=87275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 16:47:49.644191 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.notifications [None req-8d30443f-f4a7-4b1a-8aeb-9fd8f2b0edd4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f9a5f7afefa46b297c30ee8130d2c48'} {{(pid=87275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 16:47:49.644861 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.notifications [None req-8d30443f-f4a7-4b1a-8aeb-9fd8f2b0edd4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f9a5f7afefa46b297c30ee8130d2c48'} {{(pid=87275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 16:47:49.657891 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.notifications [None req-8d30443f-f4a7-4b1a-8aeb-9fd8f2b0edd4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f9a5f7afefa46b297c30ee8130d2c48'} {{(pid=87275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 16:47:49.664030 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 628/1252] 10.222.0.104 () {58 vars in 1229 bytes} [Tue Aug 9 16:47:49 2022] DELETE /identity/v3/users/6f9a5f7afefa46b297c30ee8130d2c48 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 16:47:49.854563 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7667c52-b737-4391-876c-f6eae682ea8b service placement] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:47:49.866416 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7667c52-b737-4391-876c-f6eae682ea8b service placement] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:47:49.943971 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cd816f-7fa9-47b8-b8c2-4e128ff5a6a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce95c8faa1d4165b111ca9c55852804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:47:49.944508 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cd816f-7fa9-47b8-b8c2-4e128ff5a6a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:47:49.944784 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cd816f-7fa9-47b8-b8c2-4e128ff5a6a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:47:49.945052 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cd816f-7fa9-47b8-b8c2-4e128ff5a6a2 admin admin] PATH_INFO: `/v3/projects/c8bd20b38bda4c779d47edbdcc78ab5f` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:47:49.946213 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cd816f-7fa9-47b8-b8c2-4e128ff5a6a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8bd20b38bda4c779d47edbdcc78ab5f)` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:47:49.949085 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cd816f-7fa9-47b8-b8c2-4e128ff5a6a2 admin admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:47:49.997572 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.notifications [None req-e5cd816f-7fa9-47b8-b8c2-4e128ff5a6a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8bd20b38bda4c779d47edbdcc78ab5f', 'request_id': 'req-e5cd816f-7fa9-47b8-b8c2-4e128ff5a6a2'} {{(pid=87276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 16:47:50.003142 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.notifications [None req-e5cd816f-7fa9-47b8-b8c2-4e128ff5a6a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8bd20b38bda4c779d47edbdcc78ab5f', 'request_id': 'req-e5cd816f-7fa9-47b8-b8c2-4e128ff5a6a2'} {{(pid=87276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 16:47:50.014154 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.notifications [None req-e5cd816f-7fa9-47b8-b8c2-4e128ff5a6a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8bd20b38bda4c779d47edbdcc78ab5f', 'request_id': 'req-e5cd816f-7fa9-47b8-b8c2-4e128ff5a6a2'} {{(pid=87276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 16:47:50.038425 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.notifications [None req-e5cd816f-7fa9-47b8-b8c2-4e128ff5a6a2 admin admin] The token cache is being invalidate because project c8bd20b38bda4c779d47edbdcc78ab5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87276) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 16:47:50.038716 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.notifications [None req-e5cd816f-7fa9-47b8-b8c2-4e128ff5a6a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 16:47:50.039339 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.notifications [None req-e5cd816f-7fa9-47b8-b8c2-4e128ff5a6a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 16:47:50.040846 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 625/1253] 10.222.0.104 () {58 vars in 1238 bytes} [Tue Aug 9 16:47:49 2022] DELETE /identity/v3/projects/c8bd20b38bda4c779d47edbdcc78ab5f => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 16:47:50.044868 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d30443f-f4a7-4b1a-8aeb-9fd8f2b0edd4 admin admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:47:50.046285 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.fernet_utils [None req-8d30443f-f4a7-4b1a-8aeb-9fd8f2b0edd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:47:50.059525 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d30443f-f4a7-4b1a-8aeb-9fd8f2b0edd4 admin admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:47:50.077704 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:47:50.115724 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f020c81b-8ccb-4f58-84c2-85c3214610ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce95c8faa1d4165b111ca9c55852804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:47:50.116348 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f020c81b-8ccb-4f58-84c2-85c3214610ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:47:50.116627 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f020c81b-8ccb-4f58-84c2-85c3214610ab admin admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:47:50.116900 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f020c81b-8ccb-4f58-84c2-85c3214610ab admin admin] PATH_INFO: `/v3/users/faa8111f8cb84ac09abdae6fd4dc4b96` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:47:50.118046 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f020c81b-8ccb-4f58-84c2-85c3214610ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=faa8111f8cb84ac09abdae6fd4dc4b96)` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:47:50.120482 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f020c81b-8ccb-4f58-84c2-85c3214610ab admin admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:47:50.165490 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.notifications [None req-f020c81b-8ccb-4f58-84c2-85c3214610ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'faa8111f8cb84ac09abdae6fd4dc4b96'} {{(pid=87275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 16:47:50.172101 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.notifications [None req-f020c81b-8ccb-4f58-84c2-85c3214610ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'faa8111f8cb84ac09abdae6fd4dc4b96'} {{(pid=87275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 16:47:50.178978 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.notifications [None req-f020c81b-8ccb-4f58-84c2-85c3214610ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'faa8111f8cb84ac09abdae6fd4dc4b96'} {{(pid=87275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 16:47:50.179583 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.notifications [None req-f020c81b-8ccb-4f58-84c2-85c3214610ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'faa8111f8cb84ac09abdae6fd4dc4b96'} {{(pid=87275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 16:47:50.191496 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.notifications [None req-f020c81b-8ccb-4f58-84c2-85c3214610ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'faa8111f8cb84ac09abdae6fd4dc4b96'} {{(pid=87275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 16:47:50.197746 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 629/1254] 10.222.0.104 () {58 vars in 1229 bytes} [Tue Aug 9 16:47:50 2022] DELETE /identity/v3/users/faa8111f8cb84ac09abdae6fd4dc4b96 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 16:47:50.377617 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cd816f-7fa9-47b8-b8c2-4e128ff5a6a2 admin admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:47:50.379161 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.fernet_utils [None req-e5cd816f-7fa9-47b8-b8c2-4e128ff5a6a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:47:50.395073 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cd816f-7fa9-47b8-b8c2-4e128ff5a6a2 admin admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:47:50.450519 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9312047e-e8bb-40d8-9e78-0b58d921454c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce95c8faa1d4165b111ca9c55852804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:47:50.451074 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9312047e-e8bb-40d8-9e78-0b58d921454c admin admin] REQUEST_METHOD: `DELETE` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:47:50.451352 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9312047e-e8bb-40d8-9e78-0b58d921454c admin admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:47:50.451621 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9312047e-e8bb-40d8-9e78-0b58d921454c admin admin] PATH_INFO: `/v3/projects/902465a03c8242f281639896d6aa7953` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:47:50.452733 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9312047e-e8bb-40d8-9e78-0b58d921454c admin admin] RBAC: Authorizing `identity:delete_project(project_id=902465a03c8242f281639896d6aa7953)` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:47:50.454940 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9312047e-e8bb-40d8-9e78-0b58d921454c admin admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:47:50.462581 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:47:50.503761 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.notifications [None req-9312047e-e8bb-40d8-9e78-0b58d921454c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '902465a03c8242f281639896d6aa7953', 'request_id': 'req-9312047e-e8bb-40d8-9e78-0b58d921454c'} {{(pid=87276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 16:47:50.509044 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.notifications [None req-9312047e-e8bb-40d8-9e78-0b58d921454c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '902465a03c8242f281639896d6aa7953', 'request_id': 'req-9312047e-e8bb-40d8-9e78-0b58d921454c'} {{(pid=87276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 16:47:50.516120 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.notifications [None req-9312047e-e8bb-40d8-9e78-0b58d921454c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '902465a03c8242f281639896d6aa7953', 'request_id': 'req-9312047e-e8bb-40d8-9e78-0b58d921454c'} {{(pid=87276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 16:47:50.526980 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.notifications [None req-9312047e-e8bb-40d8-9e78-0b58d921454c admin admin] The token cache is being invalidate because project 902465a03c8242f281639896d6aa7953 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87276) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 16:47:50.527308 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.notifications [None req-9312047e-e8bb-40d8-9e78-0b58d921454c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 16:47:50.527974 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.notifications [None req-9312047e-e8bb-40d8-9e78-0b58d921454c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 16:47:50.529486 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 626/1255] 10.222.0.104 () {58 vars in 1238 bytes} [Tue Aug 9 16:47:50 2022] DELETE /identity/v3/projects/902465a03c8242f281639896d6aa7953 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 16:48:00.193784 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=43,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:48:00.523989 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=21,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:48:10.279514 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f020c81b-8ccb-4f58-84c2-85c3214610ab admin admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:48:10.280910 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.fernet_utils [None req-f020c81b-8ccb-4f58-84c2-85c3214610ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:48:10.357905 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f020c81b-8ccb-4f58-84c2-85c3214610ab admin admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:48:10.405849 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16249ee4-35e9-468c-b774-557fb52ad87f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e914013dfd8b448e8cdbd6b8399cfd0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63557f0ff1ce4ae49899b4627bafd94e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:48:10.406495 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16249ee4-35e9-468c-b774-557fb52ad87f service cinder] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:48:10.406774 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16249ee4-35e9-468c-b774-557fb52ad87f service cinder] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:48:10.407045 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16249ee4-35e9-468c-b774-557fb52ad87f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:48:10.408836 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.fernet_utils [None req-16249ee4-35e9-468c-b774-557fb52ad87f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:48:10.492592 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16249ee4-35e9-468c-b774-557fb52ad87f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:48:10.494087 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16249ee4-35e9-468c-b774-557fb52ad87f service cinder] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:48:10.512158 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 630/1256] 10.222.0.104 () {60 vars in 1370 bytes} [Tue Aug 9 16:48:10 2022] GET /identity/v3/auth/tokens => generated 2824 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 16:48:20.509418 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=90 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:48:21.821449 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9312047e-e8bb-40d8-9e78-0b58d921454c admin admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:48:21.822991 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.fernet_utils [None req-9312047e-e8bb-40d8-9e78-0b58d921454c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:48:21.896644 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9312047e-e8bb-40d8-9e78-0b58d921454c admin admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:48:21.901140 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0aa24f-b8ec-4856-8b42-9fa64a2adbb6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da49ba8d1a21406eac55503b42fea65b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63557f0ff1ce4ae49899b4627bafd94e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:48:21.901737 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0aa24f-b8ec-4856-8b42-9fa64a2adbb6 service neutron] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:48:21.902043 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0aa24f-b8ec-4856-8b42-9fa64a2adbb6 service neutron] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:48:21.902313 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0aa24f-b8ec-4856-8b42-9fa64a2adbb6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:48:21.904013 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.fernet_utils [None req-1a0aa24f-b8ec-4856-8b42-9fa64a2adbb6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:48:21.983060 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0aa24f-b8ec-4856-8b42-9fa64a2adbb6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:48:21.984502 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0aa24f-b8ec-4856-8b42-9fa64a2adbb6 service neutron] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:48:21.996476 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 627/1257] 10.222.0.104 () {60 vars in 1370 bytes} [Tue Aug 9 16:48:21 2022] GET /identity/v3/auth/tokens => generated 2871 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 16:48:23.182545 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16249ee4-35e9-468c-b774-557fb52ad87f service cinder] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:48:23.191811 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16249ee4-35e9-468c-b774-557fb52ad87f service cinder] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:48:23.195494 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cf230a-b9ad-4b24-af6f-3c990a9e8bb6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da49ba8d1a21406eac55503b42fea65b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63557f0ff1ce4ae49899b4627bafd94e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:48:23.196669 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cf230a-b9ad-4b24-af6f-3c990a9e8bb6 service neutron] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:48:23.196950 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cf230a-b9ad-4b24-af6f-3c990a9e8bb6 service neutron] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:48:23.197585 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cf230a-b9ad-4b24-af6f-3c990a9e8bb6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:48:23.198989 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.fernet_utils [None req-e3cf230a-b9ad-4b24-af6f-3c990a9e8bb6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:48:23.211868 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cf230a-b9ad-4b24-af6f-3c990a9e8bb6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:48:23.213197 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cf230a-b9ad-4b24-af6f-3c990a9e8bb6 service neutron] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:48:23.223670 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 631/1258] 10.222.0.104 () {60 vars in 1370 bytes} [Tue Aug 9 16:48:23 2022] GET /identity/v3/auth/tokens => generated 2871 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 16:48:26.245648 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0aa24f-b8ec-4856-8b42-9fa64a2adbb6 service neutron] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:48:26.254225 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0aa24f-b8ec-4856-8b42-9fa64a2adbb6 service neutron] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:48:26.258508 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9019a129-c506-4abc-8b6a-34e785eb5a90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da49ba8d1a21406eac55503b42fea65b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63557f0ff1ce4ae49899b4627bafd94e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:48:26.259110 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9019a129-c506-4abc-8b6a-34e785eb5a90 service neutron] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:48:26.259384 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9019a129-c506-4abc-8b6a-34e785eb5a90 service neutron] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:48:26.259651 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9019a129-c506-4abc-8b6a-34e785eb5a90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:48:26.261367 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.fernet_utils [None req-9019a129-c506-4abc-8b6a-34e785eb5a90 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:48:26.324005 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9019a129-c506-4abc-8b6a-34e785eb5a90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:48:26.325363 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9019a129-c506-4abc-8b6a-34e785eb5a90 service neutron] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:48:26.335014 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 628/1259] 10.222.0.104 () {60 vars in 1370 bytes} [Tue Aug 9 16:48:26 2022] GET /identity/v3/auth/tokens => generated 2807 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 16:48:29.482941 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d04d418-1166-4f02-b688-d8081ef9f4c1 None None] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:48:29.483497 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d04d418-1166-4f02-b688-d8081ef9f4c1 None None] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:48:29.483719 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d04d418-1166-4f02-b688-d8081ef9f4c1 None None] PATH_INFO: `/` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:48:29.485150 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 632/1260] 10.222.0.104 () {54 vars in 926 bytes} [Tue Aug 9 16:48:29 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Aug 09 16:48:29.514487 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf2646e-edf1-49b4-b856-0fbc8fe00218 None None] REQUEST_METHOD: `POST` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:48:29.515023 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf2646e-edf1-49b4-b856-0fbc8fe00218 None None] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:48:29.515023 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf2646e-edf1-49b4-b856-0fbc8fe00218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:48:29.537565 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.auth.core [None req-dbf2646e-edf1-49b4-b856-0fbc8fe00218 None None] MFA Rules not processed for user `cfd1352d64de487ca4675cbe113e919f`. Rule list: `[]` (Enabled: `True`). {{(pid=87276) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 16:48:29.539445 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.fernet_utils [None req-dbf2646e-edf1-49b4-b856-0fbc8fe00218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:48:29.554124 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=100 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:48:29.630397 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 629/1261] 10.222.0.104 () {58 vars in 1023 bytes} [Tue Aug 9 16:48:29 2022] POST /identity/v3/auth/tokens => generated 2876 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 16:48:29.641462 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d04d418-1166-4f02-b688-d8081ef9f4c1 None None] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:48:29.643167 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.fernet_utils [None req-9d04d418-1166-4f02-b688-d8081ef9f4c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:48:29.661457 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d04d418-1166-4f02-b688-d8081ef9f4c1 None None] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:48:29.667219 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5c3e37-2274-4c8c-9baf-e30ebd685dbe service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfd1352d64de487ca4675cbe113e919f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63557f0ff1ce4ae49899b4627bafd94e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:48:29.667823 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5c3e37-2274-4c8c-9baf-e30ebd685dbe service placement] REQUEST_METHOD: `GET` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:48:29.668102 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5c3e37-2274-4c8c-9baf-e30ebd685dbe service placement] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:48:29.668376 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5c3e37-2274-4c8c-9baf-e30ebd685dbe service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:48:29.677001 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5c3e37-2274-4c8c-9baf-e30ebd685dbe service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:48:29.678624 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5c3e37-2274-4c8c-9baf-e30ebd685dbe service placement] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:48:29.689050 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 633/1262] 10.222.0.104 () {60 vars in 1370 bytes} [Tue Aug 9 16:48:29 2022] GET /identity/v3/auth/tokens => generated 2876 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 16:48:32.850027 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf2646e-edf1-49b4-b856-0fbc8fe00218 None None] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:48:32.852422 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.fernet_utils [None req-dbf2646e-edf1-49b4-b856-0fbc8fe00218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:48:32.871521 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf2646e-edf1-49b4-b856-0fbc8fe00218 None None] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:48:32.876068 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e62cc16-4b80-436f-a2a6-0f864f870f80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce95c8faa1d4165b111ca9c55852804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:48:32.876697 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e62cc16-4b80-436f-a2a6-0f864f870f80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:48:32.877032 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e62cc16-4b80-436f-a2a6-0f864f870f80 admin admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:48:32.877445 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e62cc16-4b80-436f-a2a6-0f864f870f80 admin admin] PATH_INFO: `/v3/users/b703ae8427a04f4f93b59e3df51cd312` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:48:32.878593 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e62cc16-4b80-436f-a2a6-0f864f870f80 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b703ae8427a04f4f93b59e3df51cd312)` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:48:32.879612 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: WARNING py.warnings [None req-2e62cc16-4b80-436f-a2a6-0f864f870f80 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 09 16:48:32.879612 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: warnings.warn(msg) Aug 09 16:48:32.879612 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: Aug 09 16:48:32.881499 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e62cc16-4b80-436f-a2a6-0f864f870f80 admin admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:48:32.964950 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.notifications [None req-2e62cc16-4b80-436f-a2a6-0f864f870f80 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b703ae8427a04f4f93b59e3df51cd312'} {{(pid=87276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 16:48:32.976698 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.notifications [None req-2e62cc16-4b80-436f-a2a6-0f864f870f80 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b703ae8427a04f4f93b59e3df51cd312'} {{(pid=87276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 16:48:32.985014 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.notifications [None req-2e62cc16-4b80-436f-a2a6-0f864f870f80 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b703ae8427a04f4f93b59e3df51cd312'} {{(pid=87276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 16:48:32.985745 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.notifications [None req-2e62cc16-4b80-436f-a2a6-0f864f870f80 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b703ae8427a04f4f93b59e3df51cd312'} {{(pid=87276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 16:48:33.005033 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.notifications [None req-2e62cc16-4b80-436f-a2a6-0f864f870f80 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b703ae8427a04f4f93b59e3df51cd312'} {{(pid=87276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 16:48:33.011107 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 630/1263] 10.222.0.104 () {58 vars in 1229 bytes} [Tue Aug 9 16:48:32 2022] DELETE /identity/v3/users/b703ae8427a04f4f93b59e3df51cd312 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 16:48:33.209638 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5c3e37-2274-4c8c-9baf-e30ebd685dbe service placement] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:48:33.222479 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5c3e37-2274-4c8c-9baf-e30ebd685dbe service placement] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:48:33.280213 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510be4e3-f388-44a6-8766-7d80cc33739c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce95c8faa1d4165b111ca9c55852804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:48:33.280769 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510be4e3-f388-44a6-8766-7d80cc33739c admin admin] REQUEST_METHOD: `DELETE` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:48:33.281048 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510be4e3-f388-44a6-8766-7d80cc33739c admin admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:48:33.281320 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510be4e3-f388-44a6-8766-7d80cc33739c admin admin] PATH_INFO: `/v3/projects/aeb10702851248c4a4ae6cf657bebbf3` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:48:33.282444 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510be4e3-f388-44a6-8766-7d80cc33739c admin admin] RBAC: Authorizing `identity:delete_project(project_id=aeb10702851248c4a4ae6cf657bebbf3)` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:48:33.283468 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: WARNING py.warnings [None req-510be4e3-f388-44a6-8766-7d80cc33739c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 09 16:48:33.283468 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: warnings.warn(msg) Aug 09 16:48:33.283468 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: Aug 09 16:48:33.284646 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510be4e3-f388-44a6-8766-7d80cc33739c admin admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:48:33.344661 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.notifications [None req-510be4e3-f388-44a6-8766-7d80cc33739c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aeb10702851248c4a4ae6cf657bebbf3', 'request_id': 'req-510be4e3-f388-44a6-8766-7d80cc33739c'} {{(pid=87275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 16:48:33.350607 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.notifications [None req-510be4e3-f388-44a6-8766-7d80cc33739c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aeb10702851248c4a4ae6cf657bebbf3', 'request_id': 'req-510be4e3-f388-44a6-8766-7d80cc33739c'} {{(pid=87275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 16:48:33.357862 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.notifications [None req-510be4e3-f388-44a6-8766-7d80cc33739c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aeb10702851248c4a4ae6cf657bebbf3', 'request_id': 'req-510be4e3-f388-44a6-8766-7d80cc33739c'} {{(pid=87275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 16:48:33.375548 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.notifications [None req-510be4e3-f388-44a6-8766-7d80cc33739c admin admin] The token cache is being invalidate because project aeb10702851248c4a4ae6cf657bebbf3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87275) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 16:48:33.375831 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.notifications [None req-510be4e3-f388-44a6-8766-7d80cc33739c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 16:48:33.376452 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.notifications [None req-510be4e3-f388-44a6-8766-7d80cc33739c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 16:48:33.377918 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 634/1264] 10.222.0.104 () {58 vars in 1238 bytes} [Tue Aug 9 16:48:33 2022] DELETE /identity/v3/projects/aeb10702851248c4a4ae6cf657bebbf3 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 16:48:33.382036 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e62cc16-4b80-436f-a2a6-0f864f870f80 admin admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:48:33.383975 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.fernet_utils [None req-2e62cc16-4b80-436f-a2a6-0f864f870f80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:48:33.396761 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e62cc16-4b80-436f-a2a6-0f864f870f80 admin admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:48:33.455490 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6875bd93-30a3-4036-83af-857e1604ae8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce95c8faa1d4165b111ca9c55852804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:48:33.456123 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6875bd93-30a3-4036-83af-857e1604ae8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:48:33.456400 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6875bd93-30a3-4036-83af-857e1604ae8f admin admin] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:48:33.456668 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6875bd93-30a3-4036-83af-857e1604ae8f admin admin] PATH_INFO: `/v3/users/ede73d7b3cfc4245bd0221a7c88d75e6` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:48:33.469712 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6875bd93-30a3-4036-83af-857e1604ae8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ede73d7b3cfc4245bd0221a7c88d75e6)` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:48:33.471664 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6875bd93-30a3-4036-83af-857e1604ae8f admin admin] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:48:33.486377 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:48:33.518476 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.notifications [None req-6875bd93-30a3-4036-83af-857e1604ae8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ede73d7b3cfc4245bd0221a7c88d75e6'} {{(pid=87276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 16:48:33.525777 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.notifications [None req-6875bd93-30a3-4036-83af-857e1604ae8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ede73d7b3cfc4245bd0221a7c88d75e6'} {{(pid=87276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 16:48:33.533002 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.notifications [None req-6875bd93-30a3-4036-83af-857e1604ae8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ede73d7b3cfc4245bd0221a7c88d75e6'} {{(pid=87276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 16:48:33.533554 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.notifications [None req-6875bd93-30a3-4036-83af-857e1604ae8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ede73d7b3cfc4245bd0221a7c88d75e6'} {{(pid=87276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 16:48:33.545185 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.notifications [None req-6875bd93-30a3-4036-83af-857e1604ae8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ede73d7b3cfc4245bd0221a7c88d75e6'} {{(pid=87276) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 16:48:33.550952 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 631/1265] 10.222.0.104 () {58 vars in 1229 bytes} [Tue Aug 9 16:48:33 2022] DELETE /identity/v3/users/ede73d7b3cfc4245bd0221a7c88d75e6 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 16:48:33.740649 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510be4e3-f388-44a6-8766-7d80cc33739c admin admin] Authenticating user token {{(pid=87275) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:48:33.742763 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.fernet_utils [None req-510be4e3-f388-44a6-8766-7d80cc33739c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87275) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:48:33.755340 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510be4e3-f388-44a6-8766-7d80cc33739c admin admin] Validating token access rules against request {{(pid=87275) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:48:33.813334 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126a0776-eee9-4cf5-bae8-f10b87b58cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0c59114b4e47af86cbee7e2a704cf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ce95c8faa1d4165b111ca9c55852804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87275) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:48:33.813892 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126a0776-eee9-4cf5-bae8-f10b87b58cc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:48:33.814201 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126a0776-eee9-4cf5-bae8-f10b87b58cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:48:33.814475 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126a0776-eee9-4cf5-bae8-f10b87b58cc9 admin admin] PATH_INFO: `/v3/projects/3b7a7d5e0bd34b71868a2aa8c8861017` {{(pid=87275) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:48:33.821526 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:48:33.826405 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126a0776-eee9-4cf5-bae8-f10b87b58cc9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b7a7d5e0bd34b71868a2aa8c8861017)` {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:48:33.829267 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126a0776-eee9-4cf5-bae8-f10b87b58cc9 admin admin] RBAC: Authorization granted {{(pid=87275) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:48:33.874796 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.notifications [None req-126a0776-eee9-4cf5-bae8-f10b87b58cc9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b7a7d5e0bd34b71868a2aa8c8861017', 'request_id': 'req-126a0776-eee9-4cf5-bae8-f10b87b58cc9'} {{(pid=87275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 16:48:33.880332 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.notifications [None req-126a0776-eee9-4cf5-bae8-f10b87b58cc9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b7a7d5e0bd34b71868a2aa8c8861017', 'request_id': 'req-126a0776-eee9-4cf5-bae8-f10b87b58cc9'} {{(pid=87275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 16:48:33.889504 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.notifications [None req-126a0776-eee9-4cf5-bae8-f10b87b58cc9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b7a7d5e0bd34b71868a2aa8c8861017', 'request_id': 'req-126a0776-eee9-4cf5-bae8-f10b87b58cc9'} {{(pid=87275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 16:48:33.903524 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.notifications [None req-126a0776-eee9-4cf5-bae8-f10b87b58cc9 admin admin] The token cache is being invalidate because project 3b7a7d5e0bd34b71868a2aa8c8861017 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87275) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 16:48:33.903815 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.notifications [None req-126a0776-eee9-4cf5-bae8-f10b87b58cc9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 16:48:33.904479 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG keystone.notifications [None req-126a0776-eee9-4cf5-bae8-f10b87b58cc9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87275) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 16:48:33.906062 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: [pid: 87275|app: 0|req: 635/1266] 10.222.0.104 () {58 vars in 1238 bytes} [Tue Aug 9 16:48:33 2022] DELETE /identity/v3/projects/3b7a7d5e0bd34b71868a2aa8c8861017 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 16:48:43.547522 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:DELETE=9,keystone:SELECT=20,keystone:INSERT=1 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:48:43.900155 dv-osbrick-852610-1-ceph devstack@keystone.service[87275]: DEBUG dbcounter [-] [87275] Writing DB stats keystone:SELECT=26,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 16:51:34.841306 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6875bd93-30a3-4036-83af-857e1604ae8f admin admin] Authenticating user token {{(pid=87276) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 16:51:34.842750 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.fernet_utils [None req-6875bd93-30a3-4036-83af-857e1604ae8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:51:34.918565 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6875bd93-30a3-4036-83af-857e1604ae8f admin admin] Validating token access rules against request {{(pid=87276) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 16:51:34.978348 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4116a5c9-ff3f-48fe-835d-0ee352f781e2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cfd1352d64de487ca4675cbe113e919f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63557f0ff1ce4ae49899b4627bafd94e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87276) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 16:51:34.978951 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4116a5c9-ff3f-48fe-835d-0ee352f781e2 service placement] REQUEST_METHOD: `GET` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 16:51:34.979224 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4116a5c9-ff3f-48fe-835d-0ee352f781e2 service placement] SCRIPT_NAME: `/identity` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 16:51:34.979487 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4116a5c9-ff3f-48fe-835d-0ee352f781e2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87276) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 16:51:34.981244 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.fernet_utils [None req-4116a5c9-ff3f-48fe-835d-0ee352f781e2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87276) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 16:51:34.995020 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4116a5c9-ff3f-48fe-835d-0ee352f781e2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 16:51:34.996615 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4116a5c9-ff3f-48fe-835d-0ee352f781e2 service placement] RBAC: Authorization granted {{(pid=87276) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 16:51:35.006537 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: [pid: 87276|app: 0|req: 632/1267] 10.222.0.104 () {60 vars in 1370 bytes} [Tue Aug 9 16:51:34 2022] GET /identity/v3/auth/tokens => generated 2876 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 16:51:45.002396 dv-osbrick-852610-1-ceph devstack@keystone.service[87276]: DEBUG dbcounter [-] [87276] Writing DB stats keystone:SELECT=62 {{(pid=87276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}